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1.   INTRODUCTION 

FROG  is  an  artificial  intelligence  scheme  which  behaves  adap- 
tively  with  its  environment.   The  scheme  was  proposed  by  Professor  S.  R. 
Ray.   The  initial  design  and  computer  simulation  of  FROG  was  done  by 
John  Kreger.   The  results  were  reported  in  an  unpublished  memorandum. 
The  work  described  here  is  based  on  simulation  studies,  by  the  author, 
of  an  improved  design  of  the  mechanism. 

FROG,  as  a  mechanism,  is  an  attempt  to  simulate  the  feeding  habits 
of  a  small  animal.   FROG  is  cohabited  by  some  bugs  (both  good  and  bad 
tasting)  and  predators  (encounters  with  whom  are  considered  painful  but 
not  fatal).   The  environment  of  FROG  is  separated  into  a  number  of  regions 
characterized  by  different  surface  properties.   The  machine  learns  to 
discriminate  between  the  different  stimuli  by  means  of  their  visual 
characteristics. 

According  to  Lettvin,  Maturana  et  al.  in  "What  the  Frog's  Eye 
Tells  the  Frog's  Brain,"  the  retina  of  a  frog  contains  four  groups  of 
fibers  which  break  down  every  image  into  four  main  characteristics  which 
are  then  transmitted  to  the  brain.   The  characteristics  are: 

1.  Sustained  contrast:   The  presence  of  a  sharp  boundary, 
moving  or  still,  with  much  or  little  contrast. 

2.  Net  convexity:   The  presence  of  a  curved  boundary,  darker 
than  the  background  and  moving  on  it,  showing  most  activity 
if  the  object  moves  intermittently  with  respect  to  a  back- 
ground. 

3.  Moving  edge:   Tells  whether  or  not  there  is  a  moving  bound- 
ary in  a  larger  area  within  the  field. 
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h.      Net  dimming:   Tells  how  much  dimming  occurs  in  the  largest 
area  and  so  related  to  the  size  of  the  object. 

In  our  system  each  stimulus  is  assigned  a  value,  in  the  range 
0  to  1,  for  each  of  the  above  four  characteristic*  These  are  the  char- 
acteristics (denoted  as  visual..  ,  visual^,  visual,  and  visual,  respective- 
ly) from  which  FROG  infers  the  good  or  bad  taste  or  the  pain  it  receives 
from  a  predator. 

Each  bug  has  a  value  n(0  £  n  £  l)  for  its  good  taste  and  its 
bad  taste  is  put  as  1  -  n.   A  good  tasting  bug  is  one  whose  good  taste  is 
greater  than  its  bad  taste.   A  bad  tasting  bug  is  one  whose  bad  taste  is 
greater  than  its  good  taste.   A  bug  is  assumed  to  inflict  no  pain.   By 
contrast  the  predators  it  encounters  inflict  pain  to  a  varying  degree. 

It  is  to  be  noted  that  FROG  utilizes  the  concept  of  "continuous 
logic."  According  to  P.  N.  Marinos   "In  deductive  logic,  it  is  invariably 
assumed  that  every  proposition  is  either  true  or  false...   In  real  life, 
however,  there  are  concrete  situations  which  do  not  fit  readily  into  such 
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*  In  a  later  publication  by  Maturana  et  al.   the  number  of  classes  of 

ganglion  cells  was  revised  to  five.   Four  of  them  were  found  to  act  on 
the  visual  image  to  perform  complex  analytical  operations  that  remain 
invariant  under  changes  of  general  illumation;  the  fifth  class  measured 
the  light  intensity.   The  operations  of  ganglion  cells  are  briefly  de- 
scribed by  their  names: 

Class  1.  Sustained  edge  detection — with  non-erasable  holding. 

Class  2.  Convex  edge  detection — with  erasable  holding. 

Class  3.  Changing  contrast  detection. 

Class  h.  Dimming  detection. 

Class  5-  Darkness  detection. 

In  spite  of  this  finding  we  have  decided  to  work  with  four  visual 
characteristics  in  our  simulation  of  FROG.   Our  effort  is  to  devise  a 
cognitive  system  which  recognizes  unique  combinations  of  contexts.   By 
not  extending  the  dimensions  of  the  stimulus  (or  context)  space  to  five 
we  will  only  restrict  the  complexity  of  the  problem  without  affecting 
the  difficulty  of  the  problem.   The  approach  we  take  is  perfectly  general 
and  can  be  extended  to  any  dimensions. 


a  simple  scheme  and  the  conventional  dichotomy  of  true-false  is  highly- 
inappropriate.   In  other  words,  it  is  quite  possible  that  certain  situa- 
tions might  have  values  other  than  falsehood  and  truth."  Thus,  while  the 
only  values  a  situation  might  have  in  deductive  logic  are  0  and  1,  con- 
tinuous logic  allows  a  given  situation  to  have  the  values  0,  1,  or  some 
number  between  them.   This  is  particularly  suitable  for  our  system. 

For  each  stimulus  presented,  FROG  receives  external  data  of  two 
types,  visual  and  tactile.   The  four  visual  characteristics  can  assume 
values  in  the  range  0  to  1.   The  tactile  data  simply  specifies  the  region 
in  which  the  stimulus  appears.   When  FROG  attempts  to  feed  on  a  stimulus, 
it  is  assumed  that  there  are  external  agents  to  evaluate  the  taste  or 
the  pain  inflicted  and  make  it  available  to  FROG.   Internally  FROG  gen- 
erates hunger,  fatigue  and  alarm  signals. 

FROG  acts  like  an  adaptive  filter.   The  environment  sensory 
data,  interpreted  through  the  adaptive  filter,  and  the  somatic  signals, 
which  measure  the  requirements  of  FROG  for  feed  and  rest,  are  combined 
to  decide  upon  a  course  of  action.   The  modes  of  activity  are   (l)  feed; 
(2)  rest;   (3)  flee. 


2.   THE  BASIC  LOGIC  ELEMENTS 


2.1 


The  Basic  Elements 

The  basic  logic  elements  which  constitute  the  adaptive  filter 


are  defined  below.   All  inputs,  x. ,  and  outputs,  y,  have  values  in  the 
continuum  [0,l]  unless  contraindicated. 

Nearest 


Element  Name 
Complement  (C) 

Minimum  (m) 


Symbol 
x  -*©-+■  y 


1* 


xk 


©+y 


Analog 
NOT    y  =  1-x 


Definition 


AND    y  =  min  (x. ) 
i=l   X 


Maximum  (M) 


V 


®+y     OR     y  =  max  (x.  ) 

i=l   X 


Product  (P) 


Equivalence  (E) 


Selective 


*Memory  ( MEM ) 


:1  V 


X2* 


1)Sh: 


X2* 


Sense  Indicator   x. 


y  =  (x  )'(x  ) 

y  =  xx  if  |x1-x2|  <  0.05 


f(g)-»-y   Equiv. 

(fuzzy)  y  =  0  otherwise 


x  -+MEM)- 


y  =  x1,  if  x2  >  0.5 
y  =  0  otherwise 


y  =  1  if  x  >  0 

y  =  0  otherwise 

y  =  0  when  first  powered  "on." 
If  x-j_  is  the  first  occurrence 

of  x:  >  0,  y  =  x| 


Nearest 
Element  Name      Symbol     Analog  Definition 

Current 
*Transmittance  (T)  x -,"*"©/  \"*  y    —    Time     Stored  Value  Output  (y) 

initially       0  0 

(t=0) 

t  =  t      last  non-        min 
zero  input      /   iv 

u,n;. 

(Stored 
valued) 

i  =  no.  of 
inputs 
till  t 


1' 


*  See  the  following  section  for  further  explanation. 


2.2       The  Memory  Elements 

1.  MEM-element 

The  MEM-element  is  initially  "unset"  (no  value  stored)  and  its 
output  is  zero.   It  "sets"  to  (stores)  and  begins  to  output  its  first 
nonzero  input.   The  output  of  a  "set"  MEM-element  is  invariant  and  con- 
stant: At  any  point  in  time  the  output  will  "be  the  stored  value.   Sub- 
sequent inputs  will  neither  change  the  stored  value  nor  affect  the  output. 

2 .  T-element 

The  T-element  is  also  initially  "unset"  (i.e.  no  number  stored) 
and  its  output  zero.   The  T-element  sets  to  the  first  nonzero  input  and 
begins  to  output  the  product  —  •  (stored  value)  in  a  constant  manner.   The 
"stepping  parameter"  n  is  a  nonzero  positive  integer.   The  next  time  the 
T-element  encounters  a  nonzero  input  it  sets  to  the  new  value  of  the 

input  and  a  stepping  process  occurs  by  which  the  T-element 's  output  is 

2  1 

stepped  to  (— )  •  (stored  value).   This  process  of  stepping  by  adding  — 

to  the  fraction  multiplier  —  occurs  each  time  a  nonzero  value  is  input 


to  the  T-element  until  the  term  —  =  1.   At  this  point  the  T-element  outputs 
the  full  value  of  its  currently  stored  contents  and  can  be  considered  to 
have  reached  "full  potential."  Any  subsequent  inputs  to  this  element  will 
not  cause  the  stepping  process  to  occur  but  the  stored  value  will  set  to 
every  new  input.   At  any  point  in  time  after  a  T-element  has  reached  full 
potential  its  output  will  be  its  stored  value. 

The  particular  value  of  its  stepping  parameter,  n,  is  an  inher- 
ent invariant  characteristic  of  a  T-element.   In  the  case  of  the  simula- 
tion FROG  it  is  useful  to  have  four  variations  of  T-elements,  having  step- 
ping parameters  of  8,  6,  k   and  2.   This  result  in  FROG  having  T-elements 
that  come  up  to  full  potential  very  quickly  (n  =  2),  very  slowly  (n  =  8), 
or  at  moderate  speed  (n  =  h   or  n  =  6). 

3.   T*-element 

The  principal  macroelement  of  FROG's  memory  is  a  T*-element.   A 
T*-element ,  shown  schematically  in  Figure  2.1,  is  constructed  out  of  the 
nine  continuous  logic  elements  described  in  section  2.1  and  some  delay 
elements. 

A  T*-element  has  a  maximum  of  four  inputs  (A  ,  A_ ,  A_  to  A>  ) 
for  the  visual  characteristics  of  the  stimuli  and  an  input  B  for  a  non- 
visual  characteristic.   A  T*-element  stores  a  set  of  values  of  a  specific 
combination  of  the  four  visual  characteristics  taken  one,  two,  three  or 
four  at  a  time.   It  also  stores  all  the  different  values  of  the  nonvisual 
characteristic  of  one  kind  (e.g.  all  the  different  bad  taste  values) 
which  may  be  associated  with  the  particular  values  of  the  combination  of 
visual  characteristics  stored.   The  T*-element  forms  a  product  of  the 
minimum  of  the  visual  input  values  stored  with  the  maximum  of  all  the 
different  nonvisual  inputs  stored.   The  output  of  the  element  depends  on 


VISSTIM 
(VISUAL     INPUTS 
N  =  l,2,3  0R4) 


NONVISUAL 
(NON 
VISUAL 
INPUTS)         NBHOOD 


MODNBHOOD 
(MODIFIED 
NBHOOD) 


Figure  2.1     A  T*-Element    (Schematic) 
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how  many  occurrences  of  the  given  combination  of  visual  inputs  FROG  has 
come  accross  and  will  he  described  later. 

Another  input  to  a  T*-element  is  a  write  regulating  signal  C. 
The  element  has  two  outputs:   Output  D  is  the  main  output  of  the  T*- 
element  and  output  E  is  a  modification  of  input  C. 

The  T*-elements  are  connected  in  a  row.   Figure  2.2  shows  three 
of  them  connected  together.   Each  of  these  elements  retain  a  specific  com- 
bination of  values  of  two  visual  inputs.   The  visual  inputs  and  the  input 
B  are  the  same  for  all  the  elements.   However,  input  C,  the  regulating 
input  NBHOOD,  is  set  at  1.0  for  the  T*-element  #1  (the  leftmost  T*- 
element)  while  input  C  for  T*-element  #2  is  output  E  (the  modified  NBHOOD ] 
of  #1.   The  pattern  is  repeated. 

To  understand  the  operation  of  a  T*-element  consider  a  T*- 
element  which  is  the  leftmost  one  in  the  'chain'  described  above. 

Assume  FROG  has  just  "eaten"  a  bad  tasting  bug.   The  bug  has 
specific  values  for  its  visual  characteristics  and  bad  taste.   Assume 
FROG  wants  to  record  the  specific  combination  of  the  values  of  the  second 
and  the  third  visual  inputs  (visual-  and  visual-).   The  value  of  the 
second  visual  input  appear  on  the  A  line  and  that  of  the  third  visual 
input  appear  on  the  A  line.   The  value  of  the  bad  taste  is  placed  on  the 
B  input  line  of  the  chain.   Now,  refer  to  Figure  2.3  for  the  following 
discussion.   Consider  what  happens  in  block  1.   The  S-element  on  the  B 
input  gates  in  the  bad  taste  only  if  it  is  greater  than  or  equal  to  .5* 
This  value  is  input  to  the  m-element  of  block  1.   Another  input  to  this 
m-element  is  the  signal  NBHOOD,  which  has  been  set  initially  at  1.0. 
The  third  input  to  this  m-element  (the  complement  of  the  output  of  the 
now  "unset"  MEM-element  in  block  3)  is  also  1.0.   The  output  of  this  m- 
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element  (which  is  greater  than  .5,  since  it  is  equal  to  the  input  bad 
taste)  becomes  an  input  to  the  M-element  of  block  1;  the  other  input 
(the  output  of  the  still  "unset"  MEM-element  of  block  3)  is  0.0.   The 
output,  then,  of  the  M-element  is  the  same  as  the  input  bad  taste  value. 
This  output,  which  is  >_  .5,  gates  in  the  visual  inputs  through  the  S- 
elements  in  block  2  and  the  taste  input  through  the  S-elements  in  block  3. 
These  stimuli  then  "set"  the  MEM-elements  in  their  respective  blocks. 
The  MEM-elements,  after  being  "set,"  begin  to  output  the  values  of  visual 
characteristics  and  taste  that  are  still  being  input  to  them.   These 
values  reach  the  E-elements,  and  since  each  of  the  elements  has  two  equal 
inputs,  they  now  output  the  values  of  visual  characteristics  (in  block  2) 
and  the  taste  value  (in  block  3)  that  were  input  to  the  T*-element.   The 
m-element  in  block  2  now  select  the  minimum  value  of  the  visual  inputs. 
This  value  is  nonzero,  so  the  lower  Si-element  output  in  block  h   will  be 
1.0,  which  is  input  to  a  m-element.   Since  the  output  of  the  E-element  in 
block  3  is  nonzero,  the  upper  Si-element  in  block  h   will  output  1.0.   So 
the  following  C-element  will  output  0.0  which  is  the  other  input  to  the 
m-element  in  the  same  block.   The  m-element  will  now  output  0.0.   The 
taste  input  which  is  gated  in  at  the  S-element  in  block  3  is  delayed  till 
the  output  of  the  m-element  is  reliable.   The  delayed  taste  input  is  now 
applied  as  x   input  to  the  S-element  in  block  5.   Since  the  x   input  is 
0.0  the  taste  input  is  not  gated  into  the  MEM-element  of  block  5-   The 
block  5  is  similar  in  structure  to  block  3  and  its  function  will  be 
apparent  later. 

The  MEM-element  in  block  5  is  still  unset.  The  inputs  to  the 
E-element  of  block  5  are  both  0.0  so  it  outputs  0.0.  The  output  of  the 
E-element  in  block  3  is  the  taste  value  stored  in  block  3  and  that  of  the 
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E-element  in  block  5  is  0.0.   So  the  output  of  the  lower  M-element  in 
block  6  is  >_  .5.   The  output  of  the  upper  element  is  the  maximum  of  the 
stored  values  in  the  MEM-elements  in  block  3  and  5;  right  now  that  would 
be  the  block  3  output  since  the  other  is  unset.   This  value  is  now  gated 
into  block  7  through  the  S-element  by  the  output  of  the  lower  M-element 
which  is  >_  0. 5- 

One  input  to  the  block  7  is  the  minimum  of  all  the  visual  input 
values  stored  in  the  MEM  values  of  block  2.   The  other  input  is  the  maxi- 
mum of  the  stored  values  in  the  MEM-elements  of  blocks  3  and  5.   Each  of 
these  inputs  go  to  a  Si-element.   Since  the  inputs  are  nonzero  the  SI- 
elements  begin  to  output  1.0.   The  inputs  also  go  to  a  P-element  which 
forms  their  product.   The  product  is  the  x  input  to  the  upper  S-element 
in  block  7»   The  x  input  to  this  S-element  is  the  minimum  of  the  outputs 
of  the  above  two  Si-elements.   Since  these  outputs  are  each  1.0,  the 
x  input  to  the  S-element  is  1.0  and  the  output  of  the  P-element  is  gated 
through  to  the  T-element. 

At  this  point,  the  E  output  of  the  T*-element ,  the  modified 
version  of  the  NBH00D  signal  becomes  defined.   The  E  output  of  the  T*- 
element  is  1.0  only  if  in  block  8  the  delayed  C  input  to  the  element  is 
1.0  and  there  is  no  output  from  the  upper  S-element  of  block  J.      The  1.0 
on  the  C  input  (NBH00D  signal)  is  delayed  for  long  enough  span,  y,  to 
allow  a  signal  to  be  output  from  the  upper  S-element  of  block  7  (i.e.  to 
allow  it  to  become  reliable).   Until  this  happens,  since  the  upper  input 
to  the  m-element  in  block  8  is  zero,  the  E  output  is  zero.   Now,  when  the 
upper  S-element  of  block  7  has  an  output  value  >  0,  the  side  input  to  the 
m-element  in  block  8  becomes  0.0,  so  that  even  after  the  delayed  NBH00D 
signal  reaches  the  top  input  of  the  m-element,  the  E  output  continues  to 
remain  zero. 
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To  return  to  block  7>  the  output  from  the  S-element  has  caused 
the  T-element  to  "set,"  i.e.  store  this  value  and  begin  out putting  —  x 
this  value.   The  T-element  output  becomes  the  x   input  to  the  lower  S- 
element  in  block  7.   The  xp  input  to  this  S-element  is  the  minimum  func- 
tion of   (l)  the  SI  function  of  the  visual  input  to  block  7  which  is 
1.0  and   (2)  the  complement  of  the  SI  function  of  the  nonvisual  input  to 
block  7  which  is  0.0.   Thus  the  x  input  to  the  lower  S-element  in  block  7 
is  0.0  with  the  result  that  the  D  output  of  the  T*-element  is  0.0,  which 
is  what  it  should  be,  for  this  is  a  "write"  into  the  memory  cell,  not  a 


This  is  a  complete  "write"  cycle  for  T*-element  #1,  but  now  let 
us  consider  what  happens  to  the  still  "unset"  T*-element  #2.   Its  A  ,  A 
and  B  inputs  are  the  same  as  that  for  the  first  cell,  but  the  C  input, 
NBH00D  (before  and  after  modification  by  T*-element  #1 )  is  now  0.0.   The 
effect  of  this  will  be  to  cause  zero  to  be  output  by  the  m-element  in 
block  1  and  since  the  MEM-element  in  block  3  is  unset,  the  output  of  the 
M-element  will  be  0.0.   This  zero  is  the  x   input  for  each  of  the  S- 
elements  in  blocks  1  and  2  with  the  result  that  the  visual  and  nonvisual 
inputs  to  the  T*-element  will  not  be  gated  into  the  T*-element.   However, 
let  us  look  at  the  output  E  of  this  second  T*-element ,  for  it  will  be 
input  for  the  T*-element  #3.   The  complement  of  the  SI  function  of  the 
upper  S-element  in  block  7  will  be  1.0.   This  value  will  be  one  input  to 
the  m-element  in  block  8;  the  other  will  be  the  value  coming  out  of  the 
delay  unit.   However,  this  value,  both  before  and  after  delay  time,  u, 
has  elasped,  will  be  0.0.   Therefore,  after  one  memory  cell  in  the 
chain  has  been  written  into,  no  "unset"  T*-element  to  the  right  of  that 
memory  cell  may  be  written  into. 
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A  T*-element  can  be  written  into  a  second  time  if  the  visual 
inputs  match  the  values  stored  in  the  MEM-elements  of  block  2.   The 
taste  value  need  not  necessarily  match  the  value  stored  in  block  3.   A 
"set"  T*-element  will  always  gate  through  any  visual  input  and  any  B  in- 
put greater  than  .5  to  blocks  2  and  3.   This  will  be  because  the  output  of 
the  MEM-element  in  block  3  will  cause  M-element  in  block  1  to  output  some 
value  >_  0.5»  which,  in  turn, will  cause  the  S-element  gates  to  be  constantly 
open  in  blocks  2  and  3.   Since  the  visual  inputs  match  the  stored  values 
in  block  1,  the  E-elements  will  output  nonzero  values,  and  so  the  visual 
input  to  block  7  will  be  nonzero.   On  the  other side,  the  B  input  will  be 
compared  with  the  stored  value  in  MEM-element  of  block  3.   If  they  match, 
the  E-element  will  output  a  nonzero  value.   The  rest  of  the  action  will 
be  exactly  similar  to  what  happened  when  the  element  was  set  for  the 
first  time.   A  nonzero  product  will  be  transmitted  to  the  T-element  which 
will  increment  the  stepping  parameter  and  set  it  to  the  new  product 
which  will  essentially  have  the  same  value  as  the  old  product  stored. 

If  the  taste  input  does  not  match  the  value  stored  then  the 
E-element  output  of  block  3  will  be  zero.   This  causes  the  first  input  to 
the  m-element  of  block  h   to  be  1.0.   The  second  input  is  also  1.0  since 
the  visual  inputs  matched.   The  m-element  output  will  thus  be  1.0  and 
will  gate  in  the  delayed  taste  input  to  block  5  which  will  set  the  MEM- 
element  in  that  block  to  the  new  B  input  value.   Block  6  is  arranged  to 
output  the  maximum  of  the  two  stored  values.   The  two  inputs  to  block  7 
will  now  be  defined  and  the  T-element  will  be  set  to  the  new  product 
(which  may  not  necessarily  be  the  same  as  the  old  one)  and  increment  the 
stepping  parameter. 


15 

The  purpose  of  "block  5  is  now  apparent.   It  is  to  store  a 
second  value  of  the  nonvisual  input  (bad  taste  in  this  case)  which  may  be 
associated  with  a  given  combination  of  visual  inputs.   Block  pairs  like 
h   and  5  may  be  repeated  to  provide  for  more  different  values  of  the  non- 
visual  input.   In  our  simulation  we  did  not  need  to  provide  for  more  than 
two. 

The  T*-element  will  be  written  a  third  time,  a  fourth  time  and 
so  on  at  the  subsequent  appearances  of  the  same  combination  of  visual 
inputs  and  a  bad  taste  value  (>_  0.5)  which  may  or  may  not  match  the  stored 
values.   Note  that  the  bad  taste  value  transmitted  by  block  6  to  P-element 
in  block  7  is  always  the  maximum  of  all  the  different  bad  taste  values 
encountered  till  then  for  the  given  visual  inputs.   Also  note  that  the 
second  input  to  the  m-element  in  block  h   is  always  0.0  except  when  all 
the  visual  inputs  match  the  stored  values  in  block  2.   This  prevents  the 
input  taste  value  (the  B  input)  to  be  gated  into  block  5  unless  the  visual 
inputs  match. 

Now  consider  what  will  happen  if  a  different  set  of  A  ,  A 
input  values  are  input  to  the  chain.   They  will  reach  the  T*-element  #1 , 
the  one  that  is  "set."  As  has  been  said  previously,  a  "set"  T*-element 
always  gates  the  A  and  B  inputs  to  block  2  and  3.   Since  the  MEM-elements 
are  already  set,  the  new  inputs  will  not  affect  them,  but  will  be  com- 
pared with  the  MEM-element  outputs  at  the  E-elements.   Since  we  are 
assuming  that  at  least  one  visual  input  is  not  within  allowed  tolerances 
for  the  E-elements,  one  or  more  E-elements  in  block  2  will  output  zero. 
The  visual  output  from  block  2  will  then  be  zero  which  inhibits  the  taste 
signal  to  go  to  block  5-   Block  3  could  output  some  nonzero  value  if  the 
B  input  matched  the  value  stored  in  block  3-   So  the  block  6  output  may 
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or  may  not  "be  zero.   The  block  2  output  being  zero  both  the  S-elements  in 
block  T  will  be  inhibited.   So  the  D  output  of  the  leftmost  T*-element 
will  be  zero.   Also  the  E-output  of  this  T*-element  will  be  1.0  after 
time  y.   So  input  C  of  the  T*-element  #2  is  1.0  and  this  will  become  "set" 
in  exactly  the  same  manner  as  the  leftmost  T*-element. 

The  NBH00D  signal  functions  solely  to  tell  the  chain  that  a  T*- 
element  has  been  written  into  for  a  given  combination  of  visual  inputs 
and,  hence,  once  this  occurs,  not  to  write  into  it  for  a  different  set  of 
visual  inputs.   Note  that  for  a  given  combination  of  visual  inputs  the 
T*-elements  can  hold  more  than  one  B-input  values.   In  the  present  simula- 
tion provisions  are  there  for  two  such  values.   The  NBH00D  signal  makes 
sure  that  the  writing  of  a  new  combination  proceeds  sequentially  down 
the  chain  from  left  to  right. 

All  of  the  above  discussion  pertains  only  to  "writing"  into 
the  T*-element  memory  cells.   Now  the  question  arises  how  is  a  T*- 
element  caused  to  output  the  current  output  state  of  its  T-element? 
The  process  occurs  contextually,  when  FROG  has  just  seen  a  stimulus  and 
its  memory  cells  must  be  consulted  to  see  if  FROG  has  had  any  experiences 
with  this  stimulus  in  its  past  and  if  so,  whether  they  were  good  or  bad 
experiences.   Obviously,  then,  no  nonvisual  input  is  presented  to  the 
memory  in  this  case,  for  feeding  has  not  yet  taken  place;  thus,  the  non- 
visual  input  to  a  T*-element  during  a  read  cycle  is  zero. 

The  "reading"  process  occurs  in  the  following  manner.   The 
visual  stimulus  is  presented  to  all  T*-element  in  the  chain  at  once 
(reading,  it  will  be  seen,  does  not  have  to  occur  sequentially,  as  does 
writing).   The  visual  inputs  will  be  gated  into  block  2  of  each  of  the 
'set'  T*-element  in  the  chain.   If  the  current  visual  input  values  are 
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close  enough  (to  within  +_  0.05)  to  that  which  are  stored  in  the  block  2 
MEM-elements,  then  the  E-elements  in  block  2  will  output  nonzero  numbers; 
if  not,  no  read  will  occur.   Wow  recall  that  the  x_  input  to  the  lower 
S-element  in  block  7  is  the  minimum  of  two  inputs   (l)  the  SI  function 
of  the  visual  output  from  block  2,  which  is  1.0  and   (2)  the  complement 
of  the  nonvisual  input  from  block  6,  which  (since  the  B  input  to  the 
T*-element  is  zero)  is  1.0,  with  the  result  that  this  second  input  to 
the  m-element  is  also  1.0.   Thus,  since  the  m-element  is  outputting  1.0, 
the  current  output  status  of  the  T-element  is  caused  to  be  output;  no 
stepping  of  the  T-element  will  occur  for  there  is  no  input  to  it  in  the 
read  cycle. 

A  write  into  an  "unset"  element  cannot  possibly  occur  by 
accident  during  a  read  cycle,  for  if  a  T*-element  is  "unset"  and  the 
nonvisual  input  is  zero,  then  the  visual  stimulus  input  will  not  get 
past  the  S-elements  in  block  2.   Also  write  into  a  block  5  of  a  'set' 
T*-element  is  not  possible  as  the  B  input  is  zero. 
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3.   LOGICAL  DESIGN  OF  THE  SYSTEM 

y 

As  has  been  mentioned  earlier  FROG,  as  a  cognitive  system, 
is  like  an  adaptive  filter,  such  that  when  the  input  sensory  data  and 
the  somatic  signals  are  presented  a  course  of  action  for  FROG  is  de- 
cided.  It  consists  of  a  'memory'  where  the  experiences  with  different 
stimuli  are  stored,  i.e.  which  develops  a  'model'  of  the  world  from 
which  the  stimuli  are  drawn.   The  memory  is  followed  by  a  'memory  in- 
tegration unit'  (MIU),  which  is  to  handle  the  various  memory  outputs 
properly  on  presentation  of  a  stimulus  and  to  make  them  available  to  a 
'decision  unit'  (DU),  which  decides  on  the  mode  of  activity. 

3.1       Structure  of  the  Memory 

Structurally  the  memory  of  FROG  is  divided  into  several  parts 
(memory  planes)  equal  in  number  to  the  number  of  regions  in  the  environ- 
ment.  Experiences  in  the  various  regions  are  stored  in  separate  memory 
planes.   The  memory  plane  for  each  region  is  again  divided  into  three 
parts.   The  first  is  a  good  taste  memory  (GTM)  which  associates  the 
distinguishing  visual  characteristics  of  good  tasting  bugs  with  their 
tastes.   The  second  is  the  bad  taste  memory  (BTM)  which  associates  the 
visual  characteristics  of  bad  tasting  bugs  with  their  tastes.   The 
third  is  a  predator  memory  (PM)  which  associates  the  visual  characteris- 
tics of  a  predators  with  the  amount  of  pain  they  inflict. 

The  association  of  a  nonvisual  input  (good  taste,  GT,  bad 
taste,  BT,  or  pain  inflicted,  PAIN)  with  visual  characteristics  or  its 


In  the  sense  of  psychologists;  meaning,  a  response  judgment  requiring 
an  extended-time  "consideration"  of  the  stimulus  data  as  opposed  to  a 
recognition  task  in  which  the  response  is  relatively  rapid  and  automatic 


19 

combinations  is  done  in  a  T*-element  as  described  in  Chapter  2.   The 
question  now  arises  as  to  how  these  T*-elements  be  arranged  within  a 
memory  to  simulate   an  efficient  learning  scheme.   The  strategy  adapted 
in  FROG  is  described  below. 

First  of  all,  we  see  if  any  of  the  four  visual  characteristics 
might  be  a  basis  for  discrimination  between  various  stimuli.   For  this, 
we  take  three  sets  of  four  chains  of  T*-elements  and  place  a  set  in 
each  memory.   These  T*-element  have  one  visual  input  each.   The  D  out- 
puts of  all  the  T*-elements  in  each  chain  are  connected  to  one  M-element 
(see  Figure  3-l).   Thus  the  T*-elements  in  chain  1  in  BTM  would  associ- 
ate first  visual  characteristic  of  a  particular  stimulus  with  its  bad 
taste.   The  second,  the  third  and  the  fourth  chains  in  each  memory 
would  perform  similar  functions  with  the  second,  the  third  and  the 
fourth  visual  characteristic  respectively.   The  outputs  of  each  of  these 
chains  in  a  particular  memory  are  then  input  to  one  M-element  as  shown 
in  Figure  3.2.   For  the  purpose  of  simulation  study  a  chain  is  made  up 
of  three  T*-elements.   So  3  stimuli  of  each  type  can  be  remembered. 

Let  us  examine  the  process  of  read  out  from  and  writing  in  to 
the  memory.   If  a  bug  has  just  been  eaten  or  a  predator  encountered,  the 
four  visual  characteristics  would  be  sent  to  each  memory;  visual  charac- 
teristic 1  to  chain  1,  etc.   The  nonvisual  inputs  good  taste  (GT),  bad 
taste  (BT)  and  pain  (PAIN)  are  also  sent  to  the  GTM,  the  BTM  and  the  PM 
respectively.   For  a  bad  tasting  bug,  writing  will  take  place  in  BTM 
only  (since  BT  >  0.5,  GT  <  0.5,  and  PAIN  =  0.0).   Whereas,  for  a  predator, 
writing  takes  place  in  PM  only  if  PAIN  >,   0.5  (   GT  =  BT  =  0  and  PAIN  >_ 
0.5). 

When  FROG  has  just  seen  a  stimulus,  a  read  is  performed  in  each 
memory  by  sending  the  visual  characteristics  to  their  respective  chains 
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Figure  3.1  Output  Arrangement  of  a  T*-Element  Chain 
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along  with  zero  nonvisual  inputs  to  all  memories.   Any  T*-element  in 
which  the  visual  input  is  numerically  within  a  neighborhood  of  0.05  of 
the  value  of  visual  characteristic  stored  in  the  MEM-element  in  block  2 
will  output  the  status  of  its  T-element.   Then  the  maximum  function  of 
all  the  T*-outputs  in  the  memory  will  be  output  from  each  memory.   That 
is,  GTM  will  output  the  numerically  greatest  impulse  possible  for  eating 
the  bug,  the  BTM  the  numerically  greatest  possible  impulse  for  avoidance 
of  the  bug,  and  PM  the  numerically  greatest  possible  alarm.   These  out- 
puts, one  from  each  memory,  are  compared  in  a  manner  discussed  later. 

A  problem  arises  when,  for  example,  a  good  tasting  bug  and  a 
predator  have  approximately  equal  values  for  their  numerically  largest 
visual  characteristic  and  the  good  taste  value  of  one  is  approximately 
equal  to  the  pain  inflicted  by  the  other.  If  any  of  these  two  stimuli 
is  presented  the  GTM  and  the  PM  outputs  will  be  approximately  equal  and 
FROG  will  not  be  able  to  make  a  choice  based  on  its  memory  outputs. 

This  problem  arises  because  the  four  visual  characteristics 
are  too  general  to  form  a  basis  for  discrimination.   The  natural  solu- 
tion is  to  take  combinations  of  these  four  basic  characteristics  and 
use  them  as  inputs  to  chains.   The  four  visual  characteristics  taken 
two  at  a  time  forms  the  following  six  combinations : 

(1)  visual..  ,  visualp 

(2)  visual  ,  visual- 

(3)  visual  ,  visual, 
(k)     visual-,  visual- 

(5)  visual-,  visual, 

(6)  visual  ,  visual. 

Now  we  form  six  more  chains  of  T*-elements  in  each  of  GTM,  BTM  and  PM. 
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Each  chain  has  two  visual  inputs  and  one  nonvisual  input,  depending  on  the 
memory  involved. 

Should  the  above  combinations  prove  insufficient  as  a  basis  for 
discrimination  between  certain  stimuli,  combinations  of  the  visual 
characteristics  taken  three  at  a  time  are  utilized.   These  combinations 


are 


(l)  visual.,  ,  visual^,  visual,,, 


_1,  ,_„2>  3! 

(2)  visual  ,  visual-,  visual,, 

(3)  visual  ,  visual  ,  visual,  , 
(h)     visual  ,  visual  ,  visual, . 

Each  of  these  combinations  is  input  to  a  different  chain  of  T*-elements 
in  each  memory,  accompanied  by  a  suitable  nonvisual  input. 

The  last  level  of  discrimination  is  that  using  the  four  visual 
characteristics  taken  all  at  a  time. 

Thus  each  of  the  memories  (GTM,  BTM,  PM)  has  15  chains  of  T*- 
elements  which  may  be  divided  into  four  groups  referred  to  as  "levels." 
Level  1  consists  of  four  chains  of  T*-elements  that  have  as  their  visual 
inputs  the  four  basic  visual  characteristics  of  the  stimulus.   Level  2 
consists  of  the  six  chains  of  T*-elements  that  have  as  their  inputs  the 
combinations  of  the  four  basic  characteristics  taken  two  at  a  time. 
Level  3  consists  of  the  four  chains  of  T*-elements  that  have  as  their 
visual  inputs  the  basic  characteristics  taken  three  at  a  time.   Level  h 
consists  of  the  chain  which  has  as  its  visual  inputs  the  combination  of 
the  four  basic  visual  characteristics  taken  four  at  a  time.   Now  we  can 
justify  why  it  is  necessary  to  have  upto  four  A  inputs  to  a  T*-element. 
Level  1  chains  need  T*-elements  with  one  visual  input  (A  ) .   Level  2 
chains  need  T*-element  with  two  visual  inputs  and  so  on.   The  GTM,  the 
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BTM  and  the  PM  all  have  the  same  structure  with  the  only  physical  dif- 
ference being  the  nonvisual  input  to  the  memory.   The  level  output  of  any 
level  is  the  maximum  function  of  all  the  T*-element  outputs  of  that  level. 

The  different  kinds  of  T*-elements  not  only  differ  in  the  num- 
ber of  visual  inputs  that  it,  can  handle  but  also  in  the  value  of  n.   It 
is  at  this  point  that  this  variation  becomes  meaningful.   It  is  apparent 
that,  in  going  from  level  k   to  level  1,  there  is  an  increasing  generality 
in  the  visual  inputs  to  the  chain,  level  1  being  the  most  general  and 
least  specific  and  level  k   being  the  least  general  and  most  specific. 
Thus,  the  most  general  level  should  learn  the  slowest  in  order  to  avoid 
making  mistakes  in  discrimination  of  a  very  broad  nature;  but  as  the 
amount  of  generality  decreases,  faster  learning  can  be  permitted  be- 
cause a  mistake  in  the  lower  levels  would  not  be  as  disasterous  as  it 
would  be  in  level  1. 

In  level  1,  the  T*-element  contain  T-elements  which  have  n  =  8. 
Thus  it  is  necessary  for  the  visual  input  to  repeat  (within  the  allowed 
neighborhood  of  +_  0.05)  seven  times  after  the  initial  setting  of  the  T*- 
element  in  order  to  have  the  T-element  come  up  to  full  output  potential 
(full  learning).   The  T*-elements  in  level  2  contain  T-elements  for 
which  n  =  6,  so  five  repetitions  are  necessary  for  full  learning.   In 
level  3  T*-elements  n  =  U,  so  three  repetitions  are  necessary  for  full 
learning.   In  level  k,   the  most  specific  level,  the  T*-elements  contain 
T-elements  for  which  n  =  2;  thus  only  1  repetition  of  the  stored  visual 
inputs  is  necessary  for  full  learning. 

3.2       Memory  Integration 

When  FROG  has  just  seen  a  stimulus  the  visual  characteristics 
are  sent  to  all  the  memories  without  any  taste  or  pain  (i.e.  nonvisual) 
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Figure  3.3  Block  Diagram  of  a  Memory  Plane 
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information.   Let  the  stimulus  be  in  region  1.   There  is  a  signal  REGION 
which  specifies  to  FROG  the  region  in  which  stimulus  has  been  presented. 
The  read  out  should  occur  in  the  memory  plane  1  which  stores  information 
regarding  region  1.   The  GTM,  the  BTM  and  the  PM  in  plane  1  now  outputs 
twelve  values;  one  per  level,  with  four  levels  in  each  of  the  three 
memories.   These  outputs  are  compared  and  processed  in  a  manner  described 
below  by  a  'memory  integration  unit'  (MIU)  and  made  available  to  the 
'decision  unit'  (DU).   There  is  a  MIU  in  each  plane.   The  MIU  in  the 
plane  compares  three  signals  at  a  time,  starting  with  the  three  level  1 
outputs.   This  comparison  is  done  in  an  element  called  the  'memory 
integration  subunit'  (MIS).   The  outputs  from  a  memory  plane  are 
ALARM0UT,  MIU0UT  and  N0DECU.   (See  Figures  3.3  and  3.U).   If  FROG 
senses  a  predator  it  will  have  an  ALARMOUT.   If  FROG  sees  a  bug  there 
will  be  an  output,  MIUOUT,  proportional  to  its  desire  to  eat.   But  if 
no  decision  is  reached  the  N0DECU  output  of  the  plane  is  1.0.   When 
this  happens  FROG  gates  in  the  visual  inputs  to  all  the  other  planes 
for  a  readout  from  them.   This  enables  FROG  to  come  to  a  decision  based 
on  its  knowledge  of  this  stimulus  in  all  the  regions.   The  maximum  of 
the  MIUOUT  of  all  the  planes  is  the  final  MIU  output  (MIUOUTF).   The 
ALARMOUT  outputs  of  all  the  planes  are  also  input  to  a  M-element,  the 
output  of  which  is  the  final  alarm  output  (ALARMF).   If  no  decision  is 
reached  in  all  the  planes  NODECU  from  all  the  planes  will  be  1.0  so 
NODECF,  the  final  indication  of  whether  a  decision  has  been  made  or  not, 
would  be  1.0. 

The  logic  element  realization  of  the  MIS  is  shown  in  Figure 
3.5-  There  are  three  inputs  to  the  MIS;  the  three  level  outputs  from 
the  corresponding  levels  of  GTM,  BTM  and  PM  in  the  plane  (see  Figure  3-3 
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and  3.6).   There  are  three  outputs  MISOUT,  ALARMIS,  NODEC.   If  compari- 
son of  the  input  values  result  in  a  decision  (the  decision  criteria  are 
explained  below)  then  either  MISOUT  or  ALARMIS  has  a  nonzero  output;  if 
no  decision  can  be  made,  these  outputs  are  zero.   The  third  output, 
NODEC,  tells  the  MIU  whether  a  decision  has  been  made  or  not;  if  a 
decision  has  been  made,  this  output  is  zero,  if  not,  it  is  one. 

The  criteria  for  decision  by  the  MIS  are  detailed  in  Table  3.1. 
An  input  is  called  the  largest  if  it  is  larger  in  value  than  that  of  all 
the  other  inputs  by  at  least  0.05. 


Condition 

MIS  OUTPUTS 

MISOUT 

ALARMIS 

NODEC 

GRMOUT  is  the  largest  and  >_  0.5 

GTM0UT 

0 

0 

BTMOUT  is  the  largest  and  >_  0.5 

BTMOUT 

0 

0 

PMOUT  is  the  largest  and  _>  0.5 

0 

PMOUT 

0 

None  of  the  input  is  largest  by  definition 
and/or  all  of  them  are  <  0.5 

0 

0 

1 

Table  3.1  Criteria  for  Decision  by  a  MIS 
Thus  it  is  necessary  for  the  numerically  largest  input  to  be 
greater  than  0.5  and  greater  than  the  next  input  value  by  at  least  0.05, 
if  a  decision  is  to  be  amde.   If  these  conditions  are  not  met,  then  the 
outputs  MISOUT  and  ALARMIS  are  zero  and  the  output  NODEC  is  one. 

A  MIU  consists  of  four  MIS  modules  with  some  additional  logic 
to  connect  the  modules  (see  Figure  3.6).   The  first  MIS  compares  the 
level  1  outputs  of  the  three  memories,  if  no  decision  is  reached,  based 
on  the  above  criteria,  then  the  outputs  MIS0UT1  and  ALARMOUTl  are  zero 
and  N0DEC1  is  one.   This  allows  the  level  2  outputs  to  be  gated  into  a 
second  MIS.   If  comparison  in  this  MIS  yields  no  decision  the  outputs 
MIS0UT2  and  ALARM0UT2  are  zero  and  N0DEC2  is  one.   The  process  continues 
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Figure   3.6     Block  Diagram  of  a  MIU 
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for  each  of  the  MIS  modules  in  a  similar  manner.   If  no  decision  is  reach- 
ed after  comparison  of  the  level  k   outputs  the  output  NODECU  is  one.   Un- 
der this  circumstances,  the  visual  characteristics  are  gated  into  all 
other  planes  for  a  readout  from  them,  and  if  no  decisions  are  made  in 
these  memory  planes  as  well,  the  individual  NODECU  outputs  will  all  be 
1.0.   Only  when  this  happens  that  the  NODECF  output  becomes  1.0,  as 
mentioned  previously. 

The  above  discussion  assumes  that  no  decision  can  be  made  in 
any  of  the  MIS  modules.   If,  however,  a  decision  is  made  at  the  nth  MIS 
module  of  the  plane  in  which  the  visual  inputs  are  first  gated  in  then 

NODEC  will  be  zero.   This,  by  means  of  the  m-elements  between  each 
n 

module,  will  cause  zero  to  be  the  x  input  for  all  of  the  S-elements, 
the  yet  unused  modules,  preventing   (l)  any  further  comparison  and   (2) 
the  gating  of  the  visual  inputs  to  the  other  memory  planes.   Thus  only 
one  of  the  ALARMIS  or  one  of  the  MISOUT  lines  of  the  plane  will  have  a 
nonzero  output.   So  either  the  ALARMOUT  line  or  the  MIUOUT  line  of  the 
plane  will  have  a  nonzero  output  and  NODECU  of  the  plane  will  be  zero. 
The  ALARMOUT,  MIUOUT  and  NODECU  of  all  the  other  planes  will  be  zero. 
Therefore,  the  final  nonzero  output  on  MIUOUTF  (or  ALARMOUTF)  equals  the 
output  of  the  MIUOUT  (or  ALARMOUT)  line  which  is  activated.   NODECF  re- 
mains zero. 

If,  on  the  other  hand,  the  decision  is  not  reached  in  the  plane 
in  which  the  visual  inputs  have  been  gated  in  first,  but  is  reached  in 
one  or  more  of  the  other  planes,  when  the  visual  inputs  are  gated  into 
these,  then  the  NODECU  output  from  the  planes  in  which  decision  has  been 
reached  will  be  zero.   Either  the  ALARMOUT  or  the  MIOUT  of  the  plane(s) 
will  carry  a  nonzero  value.   The  NODECF  will,  therefore,  be  zero.   The 
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final  output  MIUOUTF  will  be  the  maximum  of  all  the  individual  MIUOUTs. 
Same  is  true  for  ALARMF  (see  Figure  3.k).      Notice  that  the  ALARMOUT  and 
the  MIUOUT  of  the  same  plane  cannot  have  nonzero  output  at  the  same 
time.   But  in  this  circumstance,  since  more  than  one  plane  can  have  out- 
puts, it  is  possible  to  have  nonzero  values  on  both  ALARMF   and  MIUOUTF. 
The  comparison  within  a  MIU  is  so  sequenced  that  it  proceeds 
from  the  most  general  level  of  learning  to  the  most  specific  (level  1 
to  h) .      Attempting  to  discriminate  between  the  various  classes  of  stimuli 
on  the  basis  of  level  1  output  is  a  linear  classification  scheme  while 
attempting  the  discrimination  on  the  basis  second,  third  or  fourth  level 
memory  outputs  is  a  nonlinear  classification  scheme. 

3. 3       Decision  Unit 

The  decision  unit  is  the  subunit  of  FROG  that  makes  all  the 
decisions.   Inputs  to  it  are   (l)  ALARMF   (2)  MIUOUTF   (3)  HUNGER 
(U)  the  four  basic  visual  inputs   (5)  NODECF   (6)  REGION  (the  signal 
which  tells  FROG  in  which  region  the  stimulus  has  appeared)  and   (7) 
LOCATION  (the  signal  which  tells  FROG  its  present  location,  i.e.  the 
region  in  which  it  presently  is).   The  outputs  from  it  are  the  various 
decisions . 

The  decision  logic  is  as  shown  in  Figure  3-7*   From  the  inputs 
we  derive  a  signal  called  FEED.   Whenever  the  MIU  comparisons  yield  an 
output,  NODECF  is  zero.   So  the  second  input  to  the  left  hand  M-element 
is  zero.   The  output  of  this  element  is  therefore  equal  to  MIUOUTF. 
But  when  the  MIU  comparisons  are  indecisive  NODECF  is  1.0  and  MIUOUTF 
and  ALARMF  is  zero.   Under  this  circumstance  the  output  of  the  M- 
element  equals  1.0  if  hunger  is  >  0.5  or  zero  when  hunger  is  <  0.5- 
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The  output  of  the  M-element  is  one  of  the  input  to  the  top  m-element. 
The  other  inputs  to  it  are  HUNGER  and  the  innate  visual  stimulus 
(INNATESTIM) ,  which  is  simply  the  maximum  function  of  the  four  visual 
characteristics.   It  serves  in  the  early  trials  to  tell  FROG  whether  or 
not  what  it  sees  is  a  bug  before  its  memories  have  learned  enough  about 
the  bugs. 

The  output  of  this  m-element  goes  to  a  M-element.   The  other 
input  to  this  M-element  is  nonzero  only  when  hunger  reaches  the  point 
of  starvation  (hunger  =  1.0);  when  FROG  is  starving  this  input  assumes 
a  value  equal  to  the  innate  visual  stimulus.   Thus,  when  FROG  is  at  the 
point  of  starvation,  its  feeding  impulse  would  be  fairly  large,  i.e. 
FROG  will  eat  any  bug  regardless  of  what  its  memories  say  about  its  good 
or  bad  taste.   When  FROG  is  not  starving,  the  output  of  the  m-element 
determines  the  value  of  FEED. 

FROG  can  assume  one  of  five  decisions  as  detailed  in  Table 
3.2.   The  tabulation  is  fairly  self-explanatory. 
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k.      THE  SIMULATOR 

In  this  chapter  various  aspects  of  the  simulation  are  discussed. 
First  the  various  stimuli  that  form  FROG's  world  are  described.   Following 
which  a  technique  of  simulating  loss  of  memory  is  presented.   A  descrip- 
tion of  the  simulator  comes  next. 

U.l       The  Stimuli 

The  simulation  was  done  with  three  different  classes  of  stimuli; 
good  tasting  bugs,  bad  tasting  bugs  and  predators.   Two  each  of  each  kind 
were  chosen.   These  were:   fly,  grasshopper,  honeybee,  ladybug,  beetle  and 
scorpion.   Table  U.l  lists  the  stimuli  and  their  various  visual  and  non- 
visual  characteristics.   The  bugs  that  share  a  particular  combination  with 
the  bug  being  listed  (i.e.  for  the  same  set  of  visual  characteristics,  have 
values  which  are  within  0.05  of  those  of  the  one  listed)  are  indicated  in 
parentheses  after  the  value. 

The  table  employs  the  abbreviations  detailed  below  for  the 
various  combinations  of  visual  inputs  that  are  used  as  level  inputs. 

The  assignment  of  the  various  visual  and  nonvisual  characteris- 
tics to  the  stimuli  was  based  on  how  the  author  felt  a  frog  would  react 
to  them. 
Level  1  Visual  Inputs: 

(1.1)  =  visual   (sustained  contrast) 

(1.2)  =  visual p  (net  convexity) 

(1.3)  =  visual-  (moving  edge) 


(l,U)  =  visual,  (net  dimming) 
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Level  2  Visual  Inputs 


Input  A  Input  A 

(2.1)  =  visual1  visual- 

(2.2)  =  visual  visual^ 

(2.3)  =  visual  visual, 
(2,U)  =  visual-  visual 


O 


(2.5)  =  visual-   visual- 

(2.6)  =  visual-   visual. 
Level  3  Visual  Inputs: 


Input  A 

Input  A 

Input  A 

(3,1) 

=  visual 

visual- 

visual^ 

(3,2) 

=  visual 

visual 

visual. 

(3,3) 

=  visual 

visual 

visual. 

(3,U) 

=  visual- 

visual 

visual. 

Level  U 

Visual 

Inputs  : 

Input  A 

Input  A 

Input  A 

Input  A, 

(k,l) 

=  visual 

visual- 

visual 

visual. 

k.2  Decay 

Decay  or  loss  of  "stored"  information  from  nonuse  is  a  natural 
characteristics  of  learning  processes.   Effort  has  been  made  to  simulate 
this  condition  "by  incorporating  a  decaying  routine  not  using  continuous 
logic  elements.   It  functions  in  the  following  way:   Everytime  a  "set" 
T*-element  outputs  its  stored  value  a  number,  called  the  decay  number,  is 
subtracted  from  the  stored  contents.   Every  "set"  T*-element  has  a  decay 
number.   The  decay  number  is  0.0  initially.   During  every  read  cycle, 
each  "set"  T*-element  which  does  not  output  its  current  output  status, 
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(i.e.  its  information  is  not  used)  would  have  its  decay  number  incremented 
by  0.0005.   On  the  other  hand,  if  it  were  caused  to  output  during  that 
cycle,  then  the  amount  0.0005  would  be  subtracted  from  the  number.   Thus 
if  a  T*-element  after  being  "set"  did  not  output  for  four  cycles  in  a 
row,  its  output  during  the  next  read  cycle,  would  have  0.0020,  the  decay 
number  in  this  case , subtracted  from  the  output  value.   Again,  if  the  decay 
number  for  a  T*-element  at  some  point  in  time  were  0.0025  and  this  T*- 
element  is  made  to  output  its  stored  contents  during  the  next  two  succes- 
sive read  cycles  and  is  not  caused  to  output  anything  for  the  following 
cycle,  the  decay  number  after  these  last  three  read  cycles  would  be  0.0020. 
This  value  (0.0020)  would  then  be  subtracted  from  the  output  of  this  T*- 
element  if  it  outputs  during  the  next  cycle.   Thus  provisions  are  made 
for  both  a  "loss"  of  memory  from  nonuse  and  "refreshing"  of  memory  when 
information  is  repeated. 

A  negative  decay  number  is  possible  if  a  T*-element  outputs  for 
a  sufficient  number  of  time,  however,  this  does  not  occur  very  frequently 
in  an  environment  in  which  there  are  more  than  a  few  stimuli  which  are 
presented  randomly. 

k.3  The  Simulator 

The  simulator  is  a  PL/1  program.   It  consists  of  a  main  program 
FROG.   Subroutines  (or  procedures)  are  written  to  simulate  a  general  memory 
(so  that  under  proper  specification  it  simulates  a  GTM  or  a  BTM  or  a  PM), 
a  MIU  and  a  MIS.   Function  subroutines  are  written  to  simulate  the  logic 
elements  S,  E,  P,  T  etc.   Table  U.2  lists  the  procedures  and  additional 
information  about  each.   The  source  deck  listing  in  Appendix  B  provides 
further  explanations  about  those. 
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Procedure  Name 


Purpose 


How  Invoked 


FROG  calling  program 

MIU  simulates  MIU 

MEMORY  simulates  a  memory  (GTM,  BTM  or  PM) 

TSTAR  simulates  T*-element 

T  simulates  T-element 

MEM  simulates  MEM-element 

S  simulates  S-element 

E  simulates  E-element 

P  simulates  P-element 

SI  simulates  Si-element 

C  simulates  C-element 

MAX  (*)  simulates  M-element 

MIN  (*)  simulates  m-element 

MIS  simulates  MIS 

DECAY  simulates  decaying  process 
of  T*-elements 

COMPUTE  simulates  stepping  process 
of  T-elements 

RANDOM  generates  a  random  number  on  [0,l] 
for  the  random  selection  scheme 


main  program 

"by  CALL  statement 


by  function  reference 


by  CALL  statement 


by  function  reference 


(*)   Both  MAX  and  MIN  are  built-in  generic  routines  and,  here,  are  not 
actual  procedures  within  FROG.   They  are  included  in  the  list  to 
make  the  list  of  program  components  complete. 


Table  k.2      List  of  Procedures 
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The  main  procedure,  FROG,  includes  the  program  to  generate  the 
stimuli  in  the  various  regions  in  a  random  sequence,  and  the  simulation 
of  the  'decision  unit'  (DU). 

The  number  of  stimuli  in  FROG's  enviornment  is  specified  by- 
initializing  the  variable  HOWMANY.   The  names  of  the  various  stimuli, 
their  visual  characteristics,  their  good  taste  values,  and  the  pain 
inflicted  by  each  one  of  them  is  contained  in  the  arrays  NAMES,  CHARS, 
TASTES  and  PAIN.   These  are  dimensioned  at  execution  time  by  HOWMANY. 
The  array  CHARS  has  as  many  rows  as  the  number  of  stimuli  and  four  columns 
to  accomodate  the  values  of  visual  through  visual ■  of  the  various  stimuli. 
Thus  CHARS  (i,j)  contain  the  jth  visual  characteristic  of  stimulus  number 
i.   The  four  attributes  of  the  same  stimulus  occupy  an  identical  place  in 
the  list,  i.e.  NAMES  (2),  CHARS  (2,j)  for  j  =  1,  ...,  U,  TASTES  (2)  and 
PAIN  (2)  all  refer  to  the  same  stimulus. 

At  the  start  of  the  program  the  array  RDPROB  is  initialized  with 
values  which  represent  the  desired  frequencies  in  the  random  selection 
scheme  of  appearance  of  each  of  the  stimuli  in  the  different  regions.   The 
number  of  rows  n  equals  the  number  of  different  stimuli.   The  number  of 
columns  m  equals  the  number  of  regions  in  FROG's  environment.   The 
arrays  is  initially  dimensioned  by  the  variables  HOWMANY  and  REGIONNO 
which  specify  n  and  m  respectively.   The  format  of  the  array  is  as  shown 
in  Table  U.3. 
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X 

1 

2 

.... 

m 

I 

1 

Pll 

P12 

.... 

pim 

Plx 

2 

P21 

P21 

• 

• 

n 

Pnl 

p 
ran 

P 

nx 

I 

Pxl 

Px2 

P 
xm 

P 

Table  U.3  Format  of  the  Array  RDPROB 


The  quantity  p. .  represents  the  probability  of  occurrence  of 

m 

stimulus  i  in  region  j.   The  partial  sum  P.   =  £  p..  represents  the 

ix    .=±     ij 

total  probability  of  occurrence  of  stimulus  i  over  all  the  regions.   The 

n 
partial  sum  P  .  =  Z  p. .  represents  the  combined  probability  of  occur- 

rence  of  the  various  stimuli  in  the  region  j .   Obviously 


m 


m 


P=E   I  P. .  =  E  P.   =  I  P  .  =  1. 
i.l  j-i   U    i-i   lx   j-l  XJ 

After  the  first  executable  pair  of  statements  which  read  in  the 
array  RDPROB  and  prints  it,  the  statement  labelled  BEGIN  invokes  the  sub- 
routine RANDOM  and  assigns  the  generated  random  number  to  RANNUM.   The 
following  statement  "IF  COUNTER  =  n  THEN  G0  T0  TERM"  terminates  the  pro- 
gram after  n-1  trials.   The  next  group  of  statements  allow  memory  dumps 
at  specified  trials. 

The  group  of  statements  following  the  memory  dump  indicator  uses 
the  random  number  RANNUM  to  select  which  bug  is  to  be  presented  to  FROG. 
Let  RANNUM  =  r.   This  block  of  statements  obtains  the  smallest  values  of 
i  and  j  which  satisfies  the  inequality 
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i-i      J  . 
r  <  I  P   +  S  p 
k=l  ta   £=1  1£ 

These  values  of  i  and  j  specifies  the  stimulus  to  be  chosen  for  the  trial 

and  the  region  in  which  it  is  to  appear,  and  are  assigned  to  the  variables 

BUGCHOICE  and  REGCHOICE  respectively.   The  variables  BUGNAME,  GOODTST  and 

PAIN  are  assigned  BUGCHOICEth  members  of  the  arrays  NAMES,  TASTES  and 

PAININPT.   The  array  VISUALCHAR  is  assigned  the  BUGCHOICEth  row  of  the 

array  CIIARS.   The  stimulus  for  the  trial  is  now  determined  and  its  BADTST 

and  INNATESTIM  are  evaluated.   A  message  concerning  the  stimulus  is  now 

printed. 

The  program  now  initializes  all  the  memory  outputs  from  each 
plane  to  zero  and  also  the  overall  memory  outputs.   Read  occurs  from  the 
memory  plane  corresponding  to  the  region  in  which  the  stimulus  has  been 
presented  by  calling  MIU  which  in  turn  calls  the  three  memories  (GTM, 
BTM  nad  PM)  for  that  plane.   Only  if  the  NODECU  output  of  this  plane  is 
1,  that  the  other  planes  are  read. 

From  the  memory  outputs  the  final  outputs  ALARMF,  NODECF, 
MIUOUTF  are  determined.   The  value  of  the  quantity  FEED  is  also  calculated. 

The  statement  following  that  simulates  the  "decision  unit"  (DU). 
This  decides  the  course  of  action  taken  by  FROG  for  the  given  stimulus. 
For  each  decision,  the  quantities  HUNGER  and  FATIGUE  are  changed  appropri- 
ately.  The  subroutine  DECAY  is  called  at  the  end  to  update  the  DECAYNOs. 
Appropriate  messages  are  printed  out  in  each  case.   If  FROG  decides  to 
feed  on  the  stimulus  and  no  pain  is  inflicted  by  the  stimulus  on  FROG,  the 
visual  and  taste  inputs  are  sent  to  the  GTM  and  the  BTM  of  the  memory,  for 
the  plane,  for  recording  purposes.   The  next  statement  is  a  call  to  ZERO- 
OUT,  an  entry  point  in  the  subroutine  DECAY;  this  ensures  that  any 
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T*-element  that  may  have  output  during  the  write  cycle  will  not  affect  the 
array  USE.   Specifically,  the  statement  executed  after  ZEROOUT  is  called 
sets  the  whole  array  to  binary  zero  after  which  control  is  returned  to 
FROG.   The  COUNTER  is  then  incremented  and  the  control  is  transferred  to 
the  statement  BEGIN  to  start  a  new  cycle. 
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5.   RESULTS  AND  CONCLUSION 
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5.1       Summary  of  a  Run  of  the  Simulator 

The  run  consisted  of  250  trials.   The  assigned  probabilities  of 

occurrences  of  the  various  stimuli  in  different  regions  are  tabulated 

below. 

"^^Region 

^\^      1       2       3       k 

Stimulus 

F 
G 
H 
L 
B 
S 

The  actual  number  of  occurrences  of  the  different  stimuli  in  the  dif- 
ferent regions  were 

^^Region 

^^\      1       2       3       k 

Stimulus 

F 
G 
H 
L 
B 
S 

So  the  actual  frequencies  were 


2k 

12 

13 

0 

1+9 

12 

0 

23 

12 

hi 

27 

33 

0 

0 

60 

0 

19 

0 

21 

Uo 

0 

23 

0 

12 

3U 

0 

0 

19 

0 

19 

63 

87 

55 

U5 

250 

H6 


Region 


Stimulus     - 

F 

.096 

.0U8 

.052 

.000 

G 

.0^8 

.000 

.089 

.0U8 

H 

.108 

.132 

.000 

.000 

L 

.000 

.076 

.000 

.08U 

B 

.000 

.089 

.000 

.0U8 

S 

.000 

.000 

.076 

.000 

The  frequency  of  good  tasting  bug     .  38k ,  that  of  had  tasting 
bugs  was  .1+00  and  that  of  predators  was  .  2l6. 

A  trial  by  trial  summary  of  the  run  is  given  in  Appendix  A. 

5.2       Results 

The  reactions  of  FROG  to  the  various  stimuli  are  separately  dis- 
cussed in  the  following  paragraphs. 
Fly:   A  fly  shares  the  visual  combinations 

(1,2),  (1,3)  and  (2,U)  with  a  grasshopper, 

(1,2),  (l,U)  and  (1,5)  with  a  honeybee, 

(l,3)  with  a  ladybug, 

(1,2),  (l,3)  and  (2,1+)  with  a  scorpion. 

Since  flies  are  good  tasting  they  were  quite  readily  fed  upon  by 
FROG.   Consequently  they  were  learned  fairly  quickly  compared  to  other 
stimuli.   The  first  two  times  that  a  fly  appeared  in  region  1,  it  was  fed 
upon  by  FROG  mostly  out  of  curiosity  and  high  level  of  hunger.   This  re- 
sulted in  enough  learning  for  it  to  show  a  memory  directed  approach  in  the 
third  appearance  (trial  #23).   In  all  the  following  encounters  of  a  fly  in 
region  1  FROG  had  no  problems  in  correct  recognition.   In  fact,  a  full 
learning  was  achieved  by  the  end  of  trial  #l6U  (the  12th  time  a  fly 
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appeared  in  region  l).   Learning  was  reinforced  because  of  grasshoppers 
in  region  1.   Recall,  a  fly  shares  a  few  level  1  and  level  2  combinations 
with  a  grasshopper. 

In  region  2  a  memory  directed  approach  was  taken  by  FROG  in  the 
very  first  appearance  of  a  fly  (#20).   This  approach  was  based  on  what 
was  learned  about  flies  in  region  1  in  trial  #s  1  and  3.   Being  tired 
FROG  did  not  feed  on  it.   But  the  same  cause  led  FROG  to  feed  on  the  flies 
which  appeared  in  the  trial  #s  25  and  32.   These  feedings  resulted  in 
perceptible  learning  in  the  level  h   of  GTM  of  region  2.   The  next  time 
a  fly  appeared  in  region  2  (trial  #75)  FROG's  decision  was  guided  by  the 
region  2  GTM  output.   Progressive  feeding  resulted  in  full  learning  after 
trial  #135  (the  10th  appearance  of  a  fly  in  region  2). 

In  region  3  flies  appeared  with  grasshoppers  again.   Initial 
learning  took  place  when  FROG  was  driven  by  region  1  GTM  outputs  to  feed 
on  flies.  The  first  two  times  that  they  appeared  in  region  3  (trial  #s  28, 
36).   From  the  third  time  FROG  was  guided  by  its  experience  in  this  region 
(trial  #50).   The  knowledge  was  pretty  quickly  reinforced  in  level  1  and 
level  2  by  the  simultaneous  appearance  of  the  grasshoppers  with  which 
flies  share  three  combinations  of  basic  visual  characteristics.   Full 
learning  was  observed  after  the  8th  appearance  of  a  fly  in  region  3  (i.e., 
after  trial  #126). 

It  is  to  be  noted  that  since  the  good  tasting  bugs  are  seldom 
avoided  they  are  learned  very  fast.   Therefore,  these  are  hardly  ever 
mistaken  for  anything  else.   In  fact  the  problem  is  the  other  way  round. 
The  characteristics  that  some  predators  and  bad  tasting  bugs  share  with 
some  good  tasting  bugs  cause  FROG  to  make  erroneous  judgment  about  the 
former  because  GTM  outputs  for  the  shared  visual  combinations  grow  faster 
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to  their  full  potential  than  the  corresponding  BTM  or  PM  outputs. 
Grasshopper:   A  grasshopper  shares  the  visual  combinations 
(1,2),  (1,3)  and  (2,U)  with  a  fly, 

(1.2)  with  a  honeybee, 

(1.3)  with  a  ladybug, 
(1,2),  (1,3)  and  (2,U)  with  a  scorpion. 

It  appears  in  region  1  with  flies  and  honeybees ,  in  region  3 
with  flies  and  scorpions  and  in  region  h   with  ladybugs  and  beetles. 

In  region  1,  following  a  few  hunger  forced  reactions  to  grass- 
hoppers ,  FROG  makes  a  favorable  approach  in  the  5th  appearance  of  region 
1  (#71).   The  decision  was  mostly  influenced  by  the  GTM  outputs  correspon- 
ding to  the  characteristics  shared  with  flies,  which  had  appeared  several 
times  by  this  time.   By  the  end  of  trial  #250  grasshoppers  were  fed  upon 
only  seven  times  out  of  the  twelve  times  that  it  was  presented  in  region  1. 
So  full  learning  was  not  achieved.   But  due  to  the  shared  characteristics 
between  a  fly  and  a  grasshopper  the  GTM  outputs  were  already  quite  close 
to  the  full  potential  value. 

In  region  2  first  few  memory  directed  approaches  were  guided  by 
the  GTM  outputs  of  level  1  (trial  #39,  u5),  and  later  by  the  level  2  GTM 
outputs  of  region  3  mostly  due  to  the  characteristics  shared  with  a  fly. 
At  any  rate,  trends  were  similar  to  that  observed  in  region  1  and  full 
learning  was  demonstrated  after  the  twelfth  appearance  of  a  grasshopper 
(trial  #123)  in  this  region. 

In  region  k   no  flies  appear  with  grasshoppers.   Initial  reactions 
to  grasshopper  are  thus  guided  first  by  curiosity,  then  by  the  GTM  outputs 
of  region  1  (mostly  resulting  from  eating  of  flies)  and  then  by  the  GTM 
outputs  of  region  3.   In  the  sixth  appearance  of  a  grasshopper  in  region  h 
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(trial  #170)  the  experience  in  region  k   guide  FROG  to  make  its  decisions. 
Grasshoppers  were  fully  learned  in  region  k   after  trial  #189. 

The  interesting  thing  to  note  here  is  that  the  characteristics 
shared  by  a  grasshopper  with  a  fly  reinforced  FROGs  learning  favorably 
for  both  a  fly  and  a  grasshopper.   However,  the  same  characteristics 
were  shared  by  the  scorpions.   The  reinforcement  of  the  idea  that  these 
characteristics  essentially  relate  to  good  tasting  bugs  caused  FROG  to 
suffer  a  lot  when  it  came  to  dealing  with  scorpions  as  will  be  seen 
later. 

Honeybee :   A  honeybee  shares  the  visual  combinations 
(1,2),  (1,10,  (2,5)  with  a  fly, 
(l,2)  with  a  grasshopper, 

(l,2)  with  a  scorpion. 

Honeybees  appeared  only  in  region  1  and  2. 

In  region  1  honeybees  appeared  with  both  flies  and  grasshoppers 
Flies  and  grasshoppers  are  good  tasting  and  are  mostly  eaten.   Also  the 
two  together  appear  more  frequently  than  honeybees.   So  for  the  shared 
combinations  of  visual  characteristics  development  of  an  initial  bias 
toward  good  taste  is  to  be  expected.   The  GTM  output  for  the  shared  com- 
binations should  grow  faster  than  the  corresponding  BTM  outputs,  causing 
error  in  FROG's  judgment.   The  results  confirm  the  predicted  trends. 

In  the  first  few  appearances  of  honeybees  in  region  1,  they 
were  mostly  fed  upon  by  FROG,  directed  solely  by  hunger.   First  memory 
directed  approach  occurred  in  trial  #U8  based  on  what  had  been  learned 
about  honeybees  in  region  1.   This  knowledge  was  reflected  in  the  avoid- 
ance of  honeybees  in  the  subsequent  appearances  (trial  #51 s  59 >  60,  60). 
These  decisions  were  made  on  triple  joint  combinations  (level  3 
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combinations)  since  not  much  was  learned  about  single  and  double  joint 
combinations  (level  1  and  2).   But  as  the  number  of  trials  increased  the 
level  2  and  level  1  outputs  become  significant.   Since  honeybees  share 
some  of  its  level  1  and  level  2  characteristics  with  flies  and  grass- 
hoppers, the  reason  stated  earlier  caused  FROG  to  make  some  errors 
(#67,  73,  99,  117,  127,  150).   Only  after  making  six  consecutive  errors 
of  judging  honeybees  as  good  tasting  and  feeding  on  them  on  five  occas- 
sions  FROG  learned  enough  to  recover  from  the  spell  as  is  evident  in  trial 
#151.   Thereafter  it  made  no  mistakes  with  honeybees  in  region  1.   At  the 
end  honeybees  were  not  fully  learned  because  they  were  mostly  avoided. 

In  region  2  honeybees  appeared  with  flies  only.   In  other  words 
honeybees  were  not  overwhelmingly  outnumbered  by  the  two  good  tasting 
bugs  with  which  it  shares  some  visual  characteristics.   So  mistakes  by 
FROG  due  to  shared  characteristics  happen  a  little  late  (trial  #96). 
With  the  exception  of  a  minor  sign  of  recovery  in  the  next  appearance 
(#105)  the  spell  continued  through  the  subsequent  appearances  of  honey- 
bees (trial  #12U ,  132,  1U9)  when  they  were  fed  upon  (three  out  of  four 
times)  being  taken  as  good  tasting  bugs.   This  feeding  resulted  in  further 
learning  so  that  FROG's  decisions  were  corrected  from  trial  #158  onwards. 
But  due  to  frequent  avoidance,  honeybees  were  not  fully  learned  in  region 
2  either. 

The  behavior  of  FROG  towards  honeybees  is  a  good  example  of 
how  shared  characteristics  may  confuse  issues  in  the  learning  stage. 
Ladybug :   A  ladybug  shares  the  visual  combinations 

(1,3)  with  a  fly 

(l,3)  with  a  grasshopper 
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(1,1),  (1,10.,  (2.3)  with  a  beetle, 

(l,l)  with  a  scorpion. 

It  appears  in  region  2  along  with  flies  and  beetle  and  in  region  k   with 
grasshoppers  and  beetles. 

In  region  2  a  memory  directed  approach  is  observed  in  the  third 
appearance  of  a  ladybug  (trial  #19)  and  they  were  avoided  for  a  few  sub- 
sequent appearances  (trial  #30,  56,  87,  90).   As  ladybugs  were  being 
avoided  flies  and  grasshoppers  were  being  fed  upon.   As  the  level  1  GTM 
output  rose,  the  shared  characteristic  (l,3)  with  flies  and  grasshoppers 
inclined  FROG  to  believe  that  ladybugs  were  probably  good  tasting  too  as 
is  evident  from  FROG's  reaction  to  ladybugs  in  trial  #s  125,  1U1+,  152, 
157,  159»   Ladybugs  were  fed  upon  in  these  trials  except  when  the  hunger 
was  too  low  (trial  #125).   By  feeding  on  them  FROG  found  out  they  were 
not  so  tasty  after  all  so  it  started  avoiding  ladybugs  again  (trial  #s 
178,  19U,  212,  2U5,  2U8). 

In  region  U,  for  the  first  few  appearances  of  ladybugs  FROG 
was  guided  by  its  knowledge  in  other  regions.   The  first  time  a  ladybug 
was  avoided,  it  was  due  to  what  was  learned  about  it  in  the  region  2. 
But  ladybugs  were  fed  upon  the  next  two  times  when  FROG  was  guided  by  the 
GTM  output  in  region  3.   These  two  feedings  resulted  in  an  appreciable 
learning  in  level  k   of  BTM  of  region  1+  which  kept  FROG  away  from  ladybugs 
in  region  h   for  quite  a  few  subsequent  appearances  (trial  #s  83,  85,  92, 
98,  103,  106,  155,  156,  166,  169,  175,  18U).   In  the  meanwhile  grass- 
hoppers appearing  in  this  region  were  mostly  fed  upon.   By  trial  #21 U 
the  GTM  output  for  the  shared  characteristics  (1,3)  become  more  than  0.5 
and  dominate  the  decision.   Thus  ladybugs  were  taken  as  good  tasting 
bugs  in  trial  #s  2lU,  22U,  225,  250.   These  four  feedings  were  not 
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sufficient  in  bringing  the  level  1  BTM  output  of  region  h   up  enough  to 
offset  the  corresponding  GTM  output.   This  would  have  happened  if  full 
learning  was  achieved. 
Beetle :   A  beetle  shares  the  visual  combinations 

(1,1),  (l,U)  and  (2,3)  with  a  ladybug, 

(l,l)  with  a  scorpion. 

It  appears  in  regions  2  and  k   with  ladybugs  but  no  scorpions. 

In  region  2  the  first  appearances  of  beetles  were  reacted  to 
by  FROG  completely  guided  by  its  hunger.   It  knew  nothing  about  them,  so 
it  had  no  particular  basis  for  making  a  decision.   Obviously,  the  attempts 
to  feed  on  beetles  were  not  very  pleasant  and  the  resultant  learning 
caused  FROG  to  correctly  avoid  them  (trial  #s  56,  122,  133,  1^0,  lU6,  1U7) 
only  mildly  believing  them  to  be  predators.   But  in  the  same  region  lady- 
bugs  also  appeared  with  beetles.   Because  of  the  shared  characteristics 
(l,l),  (l,U),  (2,3)  between  beetles  and  ladybugs  FROG  was  slowly  biased 
to  believe  the  beetles  as  bad  tasting  bugs  instead  and  to  avoid  them 
(trial  #s  173,  183,  199,  205,  217,  232,  2Ul ,  247,  2U9).   Although  this 
was  not  a  correct  diagnosis  of  the  features  of  a  beetle,  it  kept  FROG 
away  from  the  dangerous  stimulus  anyway.   It  was  good  in  one  way,  but, 
on  the  other  hand,  FROG  did  not  get  to  know  a  beetle  properly. 

Of  all  the  appearances  of  beetles  in  region  U,  only  once,  the 
very  first  time,  did  FROG  have  an  encounter  with  a  beetle.   This  time 
FROG's  decision  was  initiated  by  its  hunger.   But  in  all  subsequent 
appearances  FROG  was  guided  by  its  experience  in  region  2.   For  some  time 
FROG  avoided  the  beetles  thinking  them  to  be  predators  (trial  #s  72,  131, 
133,  136,  1U3,  lU8),  and  rightly  so,  after  which  shared  characteristics 
with  ladybugs  convinced  FROG  to  believe  that  the  beetles  should  be  bad 
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tasting.   Continuous  avoidance  caused  almost  no  learning  of  this  stimulus. 
Beetles  were  avoided  but  mostly  for  the  characteristics  they  share  with 
the  bad  tasting  ladybugs. 
Scorpion:   A  scorpion  shares  the  visual  combinations 

(1,2),  (1,3)  and  (2,1+)  with  a  fly, 

(1,2),  (1,3)  and  (2,U)  with  a  grasshopper. 
Scorpions  appeared  only  in  region  3  along  with  flies  and  grass- 
hoppers.  The  first  two  times  the  curiosity  of  FROG  led  it  into  two  un- 
pleasant encounters  so  that  level  k   learning  became  appreciable  to  make 
it  stay  away  from  the  scorpions  in  the  subsequent  appearances  (trial  #s 
2U,  27,  33,  1+9).   As  the  GTM  level  1  and  level  2  outputs  rose  with  more 
and  more  feeding  of  flies  and  grasshoppers,  the  shared  characteristics 
misled  FROG  to  believe  the  scorpions,  which  appeared  in  the  trial  #s  53, 
79,  8U,  9l+,  95,  107,  13l+ ,  to  be  good  tasting.   Resulting  bad  experiences 
(four  times  out  of  seven  that  FROG  actually  tried  to  eat  on  the  scorpions) 
resulted  in  enough  additional  learning  to  make  it  stay  away  from  scorpion 
for  the  next  few  appearances  of  them.   Full  learning  was  not  achieved  by 
the  250th  trial. 
5.3       Conclusion 

The  results  show  that  FROG  was  able  to  learn  the  various  stimuli 
more  or  less  correctly.   However,  there  were  mistakes  made  in  the  initial 
trials.   There  were  three  distinct  type  of  errors  made  by  FROG.   The  first 
was  deciding  to  feed  on  a  bad  tasting  bug  or  on  a  predator.   These  errors 
were  easily  corrected,  for  the  feeding  resulted  in  additional  learning 
which  alleviated  the  problem.   The  second  type  of  error  occurred  when  a 
good  tasting  bug  was  avoided.   This  error  was  difficult  to  correct;  with 
feeding  inhibited  additional  learning  was  not  possible.   Only  starvation 
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forced  feeding  helped  reverse  the  situation  for  this  error.   The  third 
type  of  error  was  made  whenever  a  predator  was  avoided,  being  taken  as 
a  bad  tasting  bug.   Although  this  error  inhibited  proper  learning,  its 
effect  was  not  altogether  undesirable.   In  the  case  of  beetles,  even  at 
the  end  of  the  run,  (i.e.  after  250  trials)  they  were  not  learned  in  the 
proper  perspective  and,  therefore,  problems  similar  to  that  resulting 
from  type  2  error  can  be  evidenced. 

Admittedly  FROG  is  not  perfect,  it  makes  mistakes.   But  these 
errors  are  not  undesirable.   In  fact,  it  makes  the  simulation  more 
realistic  and  natural. 
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APPENDIX  A 


TRIAL  BY  TRIAL  SUMMARY  OF  A  RUN  OF  THE  SIMULATOR 


A  trial  by  trial  summary  of  the  run  reported  is  given  in  the 
following  pages.   A  guide  to  the  various  columns  is  given  below. 
Trial  number    -  serial  number  of  the  trial. 

Stimulus        -  name  of  the  stimulus  presented  in  the  trial  concerned. 
Region  -  the  region  number  in  which  the  stimulus  appeared. 

Location        -  the  region  number  in  which  FROG  was  located  at  the 

time  the  stimulus  was  presented. 
Innate  stimulus  -  value  of  the  "innate  stimulus"  of  the  stimulus. 


Hunger 

Fatigue 

Miuout 

Alarm 

Feed 

Decision 


-  current  value  of  FROG's  hunger. 

-  current  value  of  the  signal  FATIGUE. 

-  value  of  the  MIUOUTF  signal  for  the  trial. 

-  value  of  the  ALARMF  signal. 

-  value  of  the  FEED  signal. 

-  mode  of  action  decided  upon  by  FROG  for  the  stimulus 
presented.   Abbreviations  used  are: 

F   =  FROG  decided  to  feed. 

NF  =  FROG  decided  not  to  feed. 

T   =  FROG  was  too  tired  to  move. 

P   =  FROG  sensed  a  predator. 

F,R  =  FROG  decided  to  feed  on  predator,  and  retreated 

to  its  safe  resting  place  in  region  1  on  encounter, 
P,R  =  FROG  sensed  a  predator  too  close  to  itself,  so  it 

decided  to  flee  to  its  safe  resting  place. 
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Specific  or  Overall  -  A  'S'  is  put  in  this  column  if  the  decision  was 
achieved  from  the  memory  outputs  for  one  region  and 
an  '0'  is  placed  if  memory  outputs  from  all  the  regions 
were  used  to  make  the  decision. 

Primary  reason  -  Entry  to  this  column  is  the  signal  which  was  primarily 
responsible  for  the  decision.   Following  abbreviations 
are  used: 
h  =  hunger 
f  =  fatigue 

n  GTM  m  =  level  m  GTM  output  of  region  n. 
n  BTM  m  =  level  m  BTM  output  of  region  n. 
n  PM  m  =  level  m  PM  output  of  region  n. 
At  times  when  the  final  decision  was  guided  primarily 
by  hunger  or  fatigue,  the  memory  output  is  entered  in 
this  column  along  with  the  value  of  hunger  or  fatigue 
in  order  to  show  how  well  the  cognitive  memory  worked. 
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APPENDIX  B 


SIMULATOR  SOURCE  DECK  LISTING 
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FROG:  /*  LDGIC  SYSTEM  SIMULATOR  */  PROC  OPT  I ONS ( MAI N) ; 

/*  FROG  IS  THE  MAIN  CALLING  PROGRAM.  IN  ADDITION,  IT  I NCHC p-<3 ATFS 
THE  SIMULATION  OF  THF  DECISION  UNIT.  */ 

OCL  (VISUALCHAR(^)  ,  /♦  FOL'R  VISUAL  CHARACTERISTICS  IF  A  RUG  */ 
GOOOTSTf  /*  GOOD  TASTE  OF  A  BUG  */ 
RADTST,  /*  PAD  TASTE  CF  A  PUG  */ 
PAIN,  /*  PAIN  INFLICTED  BY  A  PPFDATPP  */ 

HUNGER  INI  T I  ALU.  3000000)  ,  /*  THF  INITIAL  VALUC  OF  HUNGER  */ 
FATIGUE  riTTIALIO. 0000000),  /*  THF  INTTIAL  VALUE  CF  FATIGUF  */ 
INNATESTIM,  /*  INNATF  VISUAL  STIMULUS  OF  A  BUG  OR  A  P9EDAT0P  */ 
FEFO,  /*  IMPULSF  OP  F POG  TO  FFED  */ 

ALAPMOUTU),  /♦  ALARM  OUTPUTS  Oe  THE  FOUR  MEMORY  PLANES  */ 
MIU0UTI4),  /*  OUTPUTS  FROM  THF  MIU*S  TF  th=  F^'JR  mcmocy  PLANES  */ 
N1DEC4(4),  /*  THE  NDDEC-V  riiTPUTS  nF  THC  FOUR  MEMORY  PLAMFS  */ 
ALARMF,   /*  THE  PINAL  ALARM  OUTPUT  nF  THF  «c^oy  */ 
MIUOUTF,  /*  THF  FINAL  MIU  OUTPUT  */ 
NOOFCF,   /*  THE  FINAL  INDICATION  OF  WHETHER  A  DECISION  CAN 

BF  REACHED  OP  NOT  */ 
GTMEM0UT(4),  /*  FOUR  LEVEL  OUTPUTS  OF  A  GTM  */ 
BTMEMouT(4),  /*  FOUR  LEVEL  OUTPUTS  OF  A  RTM  */ 
PMEMOUTU),   /*  FOUR  LEVEL  OUTPUTS  OF  A  PM   */ 
ZERO  INITIALIO. 0000000) , 
ONE   INITIAL! 1.0000000) )  DECIMAL  FIXED  (9,7), 

RUGNAME  CHARACTER  (20), 

7EP0INT  INIT(O)  CIXED  HECIMALtl), 

(ONE  INT  INIT(1),TW0INT  I  NIT (2), 

THRFEINT     INIT(3),     FOIJRINT     INIT(^)»     BINARY    "=1X^0     , 

COUNTFR    INIT(l)     FIXED    DECIMALO), 

PRINT    FIXED    DECIMAL(l),     /*    PA^AMETEP    TO    TCLL    IF    A    "EMORY 

DUMP    IS    WANTED    */ 
(REGION,     /*    REGION     IN    WHICH    THE    STIMULUS     1PPEA°S    */ 
LOCATION    INIT(l),     /*    FR.?G    IS    INITIALLY     IN    REGION    l    */ 
GTM    INIT(1),BTM    INIT(2),    PM    INIT(3)     /*    ("ODE    NUMBERS    ftp    tHE 
DIFFFRENT    MEMORIES    */     )     BTNAPY    FIXED, 
STARLINE    CHAR(120)     IN  ITC  f 1201 •*■ !•     /*    USED    TO    SEPERATE    THF 

TRIALS    IN    THE    PPINT"UT     ♦/ 
(RANNUM,    /*    PARAMETER    TO    WHICH    A    RANDOM    NUMBER     TS    ASSIGNED    */ 
PROP)    BINARY    FLOATOl), 
(HOWMANY     INIT(6),     /*     THIS     IS     THE    NUMBER     OF     BUGS     AND    PR<"- 

CATO*S     IN    FROG'S    ENVIRONMENT    THIS    RUN    */ 
REGIONNO    INIT(4)        /*THIS     IS    THE    NUMBER     OF    RFGIONS     IN 

FROG'S  ENVIRONMENT  */  )  FIXFD  RINARY, 

/*  ALL  FUNCTION  SUBROUTINES  AR  ^  DECLARE^  AS  "ENTPIES"  */ 
T       ENTPYC  BINARY   FIXED      ,  DECIMAL  FIXED  (9,7), 

DECIMAL  FIXED  (9,7),  DECIMAL  fixFD  (9,7)  ) 
PETUPNSt  DECIMAL  FIXED  (9,7)  ), 
MEM     FNTRY(  DECIMAL  FIXED  (9,7),  DECIMAL  FIXED  (9,7)  ) 
RETUPNS(  DECIMAL  FIXED  (9,7)  ), 
SI       ENTPY(  DECIMAL  FIXED  (9,7)  ) 

RETURNS!  DECIMAL  FIXED  (9,7)  ), 
E       FNTRY(  DECIMAL  CIXED  (9,7),  DECIMAL  FIXED  (9,7)  ) 
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RETURNS!  DECIMAL  FIXFD 
P        ENTQY(  DECIMAL  FIXED  (9 

RETURNS!  nprjMAL  ^IXED 
C        ^NTOYt  DECIMAL  CIXED  19 

RETURNS!  DECIMAL  FIXED 
S       ENTRY!  DECIMAL  CIXFD  (9 

»CTJPNS(  DECIMAL  FIXFD 
RDPPPP(HPWMANY,RFGIPNNP)  RTNAR 
ARRAY  WHOSE  MEMBF&S  ARc 
CORRESPONDS  TP  A  PARTICU 
MANY  cOWS  AS  THE  NUMRER 
ENVIRONMENT.  F A CH  COLUMN 
REGION  AND  there  \» c  £<; 
DIFFERENT  REGIONS  IN  FRC 
OF  THE  APP\Y  REPRESENTS 
RPMCE  PE  A  "APTICULAR  ST 


FIXCD  (9,7)   ) 


FIXED  (9,7)  ) 


(9,7)  ), 

,7),  DECIMAL 

!9,7)  ), 

,7)  ) 

(9»7)  ), 

,7),  DECIMAL 

( 9,7)  ), 

Y  FLOAT  !  3i)  ,  /*  "ROP&OB" 

READ  IN  DURING  EXFCUTIPN 

LAR  STIMULUS  AND  thE<5E  4RF  AS 

OF  RUGS  AND  PREOATPPS  IN  FROG'S 

CORRESPONDS  TP  A  PARTICULAR 
MANY  COLUMNS  AS  THC  NUMRFR  OF 
O'S  ENVIRDNMENT.  EACH  ELFMFNT 

^Hf  rFSi^rr   pr^rapil I ty   of  pccij- 

IMULUS  TN  A  PARTICULAR  REGION.  */ 


IS    AN 

EACH 


ROW 


/*     THE     DIMENSIONS     OF     THE     FOLLOWING    F3UR     ARRAYS     ( "NAME S" , "CHAR S " , 
MTASTFS",W°AININPT")     CAN     Bc     CHANGED     IN    OprcR     TO     INCREASE    n» 
nF("REASF    THE    NUMBER    n  f    STIMULI     IN    "FROG'S"     ENVIRONMENT.    THIS 
IS     ACCOMPLISHED     BY     AL TFR  ING    THE     INITIAL     VALUE     IF     "HOWMANY"     */ 

NAMES!     HPWMANY  )     CHAR(?0)     I N I T (     / *     THE     NAMES    PF     THE    BUGS    */ 

•FLY  •, 

•GRASSHOPPER  ', 

•HONEYBEE  ', 

•LADVMJG  •, 

•BEETLE  •  , 

•SCPP°Ir'N  ')t 


CHARS(HOWMANY,^)  FIXFD  DECIMAL  (9,7)  INIT( 
/*  VISUAL  CHARACTERISTICS  OF  THE  STIMULI  */ 
0.8000000,0. 7 300 000,0. 7000  000,0.60  00000, 
0.6  000000, 0. 7000000,0. 7000  000,0.8000000, 
O.OOOOOOO, 0.70000  00,0. BO 00 000, 0.6000000, 
0.7  000  000, 0.90000  00,0. 7000  000,0.7000000, 
0. 7000 000, 0.6 0000 00,0. 9 OCOOOO, 0.7000000, 
0.7 COO 000, 0.7000  000,0. 7000000,0.9000000 


/"FLY*/ 

/^GRASSHOPPER*/ 

/♦HONEYBEE*/ 
/♦LADYBUG*/ 
/*accTL  P*/ 

/•SCnoPiPN*/  ), 


TASTES(HOWMANY)  FIXFD  DECIMAL 


/*  GOOD  TASTES  PF  THE  STIMULI 
0.9000000,/*  ej_Y  */ 
0.8000000, /* 
0.2000000,/* 
0.1000000, /* 
0.0000000, /* 
0.0000000  /* 


GpAF  SHOPPER 
HONEYBEE  */ 
LADY  BUG  */ 
BFETLE  */ 
SCDRPICN  */ 


(9,7) 
*/ 

*/ 


)  , 


INIT( 


PAININPT(HOWMANY)     FIXFD    DECIMAL     (9,7)     INI 
/*    PAIN     INFLICTED    BY     THE    STTMULI     «/ 
0.0000000,/*    PLY     */ 

GRASSHOPPER    */ 

HONEYBcE    */ 

LADYPUG    */ 

RFETLE    */ 

SCORPION    */     ) , 


0.0000000,  /* 
0.0000000,  /* 
0.0000000, /* 
0.8000000, /* 
0.9000000    /* 


CHOICE    FIXED    BINARY,     /*    CHOICE     IS    THE    SUBSCRIPT    OF     THC 

MFMBEP     ARRAYS    "NAMES",     "CHARS" , "TA S T ES    ANn    "PAININPT" 
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WHICH  IS  TO  BE  PRESENTED  TO  "FPOG"  IN  A  GIVEN  TRIAL.  */ 
/♦THE  FOLLOWING  VARIABLES  AR F  ASSOCIATED  WITH  THF  DECAY  FUNCTION  ♦  / 

(USEH4t3t4f3)  INIT((  14A)  (l)«0«B) , 

USE2(4,3,6,3)  INir((216)(l),0,B), 

USF3(  4,3,4,3)     INIT(  (  1A4HD  *0*B)  t 

USE4(4,3,3)  INIT{(     36)(1),0,R)»     BIT(1|,/*    T  =  LLS    WHETHER    OR 

NOT    A    GIVEN    T*-ELEMENT    HAS    OUTPUT    DURING    ANY    READ-CYCLE    ♦  / 
(DECAYNOK  4,  3.4,3)     INIT((144)     O.OOOOOOO), 

DFCAYN02(4,3,6,3)     INIT((216)     O.OOOOOOO), 

0ECAYN03<4,3,4,3)     INITU144)     0.0000000), 

DECAYN04(4,3, 3)    INITU  36)  0.0000000))  DECIMAL  FixFD  (9,7), 

/*  NUMBERS  TO  BE  SUBTRACTED  TO  SIMULATE  DECAYING  OF  T*- 

ELPMENTS  */ 
MEMCNT13)  FIXED  BINARY  INITU3)  0);  /♦  INDICATES  Tn  DECAY 
HOWMANY  t*_elcMFNT  TO  OFCAY  IN  EACH  CHAIN.  MEMCNT(l)  IS  USED 
FOP  GTM,  MFMCNT(?)  IS  USED  POP  3TM,  MFMCNT(3)  FOR  PM.  ♦  / 

GET  LIST( ( (RCPROBU , J)  DO  J= 1  TO  R^GIOMNO)  DO  1=1  TO  HOWMANY));  /*  PEAO 

IN  THE  LIST  OF  DESIRED  FREQUENCIES  OF  OCCURRENCE  OF  T*FLEM£NTS  */ 
PUT  EDIT( ( (RDPRHBd , J)  DO  J=  I  TO  REGIONNP)  DO  1=1  T3  HOWMANY)) 

(SKIP(5) ,6(4( X( 10),F(4,2) ) ,SKIP(2) ) ) ;  /♦  PRINT  VALUES  " EAD  IM  */ 
PFGIN:  IF  C0UNTER=?51  THEN  GO  TO  TERM;  /*  CHECK  FO*  TERMINATION 

CONDITION  */ 
/*  THE  FOLLOWING  GROUP  OF  STATEMENTS  SPECIFIES  THE  MEMORY  DUMPS  */ 
IF  CPUNTER=125  I  C0UNTER=25O 
THEN  PRINT=l; 
ELSE  PRINT=0: 
PANNUM=RANDOM;  /*  GET  A  RANDOM  NUMBER  */ 
/♦THE  FOLLOWING  GROUP  OF  STATEMENTS  DFCIDES  THF  STIMULUS  FOR 
THIS  TCIAL  AND  THE  RFGION  IN  WHICH  IT  SHOULD  APPFAR  */ 
PROB=0; 
DO  1=1  TO  HOWMANY; 
DO  J=l  TO  PCGIONNO; 
PR0B=PPC3*PDPR0B(I , J) ; 
IF  RAMNUM  <=  PROB  THEN  TO; 
CHCICE=I  ; 
REGION=J; 
GO  TO  ASSIGN; 
FNO; 
END  ; 
END; 
ASSIGN:  BUGNAME  =  N AMES ( CHOI C=) ? 

VISUALCHAR  =  CHARS (CHOI CE ,♦) ; 

GOODTST    =    TASTES(CHOICE) ; 

BADTST  =  1-  GOODTST; 

INNATFSTIM  =  MAX ( V ISUALCHAR ( 1 ) , V  I SU ALCH AR { 2 ) , VI SUAL CHAR ( 3 ) , 

VISUALCHAR(4) ) ; 
PAIN  =  PAININPT(CHCICE); 
PUT  EDIT  (STARLINE,STARLINE, «THI S  IS  T&IAL  NUMBER  •, COUNTER, 

•"FROG"  HAS  JUST  SEEN  A  BUG  IN  REGION  NUMBER  • , REGION, 
•"FROG"  IS  PRESENTLY  IN  &FGION  NUMBER  », LOCATION, 
•THIS  BUG  IS  A  •, BUGNAME, 

•VISUAL  CHARACTERISTICS  OF  THE  BUG  ARE:% 
(VISUALCHAR( I)  DC  1  =  1  TO  4), 'OTHER  INcORMATION : •  , 
•GENERAL  INNATE  STIMULUS  I S: • , I NNATEST I M , 
•HUNGER  IS:*, HUNGER, 
•FATIGUE  TS:» , FATIGUE, 
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•••FPOG"  WILL  NOW  SEAPCH  ITS  MFMORIES  POR«, 
•ANY  EXPERIENCES  WITH  THIS  RUG  IN  THF  PAST.*) 
(PAGE,SKTP(2),A,SKIP,A,SKTP(2),X(45),A,F<3),SKIP(2),X(34),A, 
C(1),SKIP,X(38),A,F(1),SKIP(?),A,A(20),SKIP,A, 
4  F(12,7),SKIP,A,SKIP,X(5),A,F(10,7),SKIP, 
X(5),A,F(10,7),SKIP,X(5),A,F<10,7), 
SKIP(2),X<40) ,A,SKIP,X( 39) ,A) ; 

DO  1=1  TO  4; 

A L ARMOUT!  I  ) =0.0300000; 

N0D£C4(I)   =0.0000000; 

MIUOUT(I)   =0.0000000; 
END; 

ALARMF=0. 0000000; 
N0DFCF=0. ooooooo; 
MIIJOUTF  =  0. 0000000; 

/*  READ  INFORMATION  OUT  OF  THE  MEMORY  PLANE  POR  THE  REGION 

IN  WHICH  THP  STIMULUS  HAS  APPEARED  */ 
CALL  MIU( VI SUALCHAR, Z FRO , Z EPP , Z ERO, P EG  ION, AL ARMOUT ( REG  I  ON )  , 
MIUOLIT(PEGION)  , N0CFC4(RCGI0N)  ,  PR  I  NT)  ; 

/♦IP  NT  DECISION  IS  OBTAINED  FROM  THIS  MEMORY  PLANE  THFN  ALL 

THE  OTHEP  MEMORY  PLANES   SHOULO  BE  READ  ♦  / 
IF  N0DFC4(REGI0N)  =  I  THEN  00; 
PUT  EDIT! • "FROG"  COULD  NOT  COME  TO  DECISION  BASED  ON  WHAT  IT', 

•PEMFM^ERS  ABOUT  THF  RUG  PRESENTED  IN  the  GIVEN  REGION. •, 
•SO  IT  WILL  NOW  SEARCH  MFMOOY  POP  PREVIOUS1, 
•FXPFRIANCES  WITH  THIS  BUG  IN  OTHFR  REGIONS*) 
(SKIP(4),4  (XJ32) t A, SKIP) ); 

11  =  1; 

RECALC:     IF    II=REGION    THEN    GO    TD    INC; 

CALL    M IU( VI SUALCHAR .ZERO, ZERO, ZERO, II, A LARMOUTt II), 

MIUOUT( II) ,N0DEC4(! I),ZFROINT) ; 
INC:     IF     11=4    THEN    GO    TO    PIN; 

I  l  =  n  +  l; 

GO  TO  RECALC; 
FIN:  FND; 
ALAPMF=MAX( ALAPMQUT( 1) , AL ARMOUT ( 2 ) , AL ARMOUT ( 3 ) , AL ARMOUT ( 4 ) ) ; 
N0DECF=MIN{NODEC4(l),N00EC4(2) , N0DEC4( 3 ) , NOD EC  4 ( 4) ) : 
MIU0UTF=MAX(MIU0UT(1),MIU0UT(2) , MI UOUT ( 3 ) , M IUOUT ( 4 ) ) ; 

/♦THE  FOLLOWING  PORTION  OF  THE  PROCEDURE  SIMULATFS  THE  DECISION 
UNIT  ♦/ 
FEED=MAX(MIN(MAX(MHjnuTP,S(NODECP,SI( S( HUNGFR , HUNGER ) ) ) ) , 

HUNGER, INN A  TEST  I M)  ,S(C ( S I ( C (HUNGER ) ) ) , INMATESTIM)  ); 

PUT  EDIT(«FINAL  MEMORY  INTEGRATION  UNIT  OUTPUT  =«,MIUOUTF, 
•ALARM  OUTPUT  OF  MIU  =•, ALARMF) 
(SKIP(2),XI35),A,F(10,7),SKIP,X(43),A,F(10,7)); 

/♦  OFCISION  1  */ 
IF  ALARMF  >  FEED  THEN 
DO; 

PUT  EOITCSTATE  OF  ALARM  =•, ALARMF, 

•IMPULSE  TO  FEED  =,,MIUOUTF, 
•FROG  HAS  SEEN  A  PRPOATOR.') 
(SKI<M2),X<4  7),A,F(10,7),SKIP,X(47),A,F(10,7), 
SKIP, X( 47) , A); 
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/*  DECISION  2  */ 

IF  REGION  =  LCCATION  THEN 

DO; 

PUT  FDITI'THF  PPEPATOR  IS  CLOSE  TO  ITSELF  SO  IT  DECIDES  TO  FIFE*  I 
(SKIP! 2),X(34) ,A)  ; 
LCCATION  =  l; 

FATIGUE  =  MIN(FATIGUE+0. lOOOOOO, ONE) ; 
FND; 

ELSE  FATIGUE  =  MAX ( FAT  IGUE-O. 2000000, ZERO ) ; 
COUNTFR  =  COUNTER  *  1 ; 
HUNGFR  ■  MI  N(HijNGER*0. 0500000, ONE); 
CALL  DECAY; 
PUT  EDIT(STARLINE,STARLINP) <SKIP(2),A,SKIP,A); 

GO   to   begin; 
FND; 

/*    DECISION    -\    */ 
ELSE     IF    FEED    <    0.5    THEN    DC; 

PUT    FDIT(     MMPULSE    CF    "FROG"    TP    FEED', FEED, 

•"FROG"    HAS    JUST    SEEN    A    BUG,    BUT    DECIDES    NOT    TO    FECD« 
STARLINE, STARLINE) 
{SKIP(2),X(40),A,F(10,7),SKIP,X(33),A,SKIP(2),A,SKIP,A) 
FATIGUE=MAXl FATIGUE -0.2000000, ZERO); 
CnUNTER-CnUNTER*l; 

HUNGFR =MIN( HUNGER +0.05000 00, ONE); 
CALL    DECAY; 
GO    TO    BEGIN; 
END; 

/*    DECISION    4    V 
ELSE    IF    FEED    >=    FATIGUE 
THEN    DO; 

PUT    EDIT(« IMPULSE    OF    "FROG"    TO    FEED    ='tFcEP, 
•FATIGUE    LEVEL    =  •  , FATIGUE, 
•••FROG"    DECIDES    TO    FEED', 
•PFSULTING    GOOD    TASTF    =',GPODTST, 
♦PFSULTING    eAD    TASTF    =',BAPTST, 
•PAIN    INFLICTED    =• ,PAIN, 
•FROG    WILL    NOW    RECORD    THE    RESULTS    OF    THIS    TRIAL     IN    ITS    MEMORIES') 
(SKIP(2).X(<,0),A,F(10,7),SKIP,XUB),A,F(10,7),SK!P, 
X(49)  ,A,3ISKIP,X(45),A,F(L0,7) ),SKIP,X(28)  ,A)  ; 
CALL    OECAY; 

IF    REGION=LOCATION    THEN    FAT  I GUE=MIN( FAT  I GUE  +  O. 050000, ONF ) ; 
FLSE    DO; 

LOCATI0N=PEGION; 

FATIGUE=MIN(FATIGUE+0.1000000,ONF ); 
END; 

/♦WRITE     INFORMATION    OF    THIS    TRIAL     INTO    "EMORIES    */ 

IF    PAIN=0.0    THEN    DO; 

CALL    MEMORY (GTM , VI  SUA LC HAP , GODOT  ST ,GTMEMOUT , ZERO  INT , REG tPN ) ; 

CALL    MEMORYIBTM, VISUALCHAP ,BACTST,     BTMFMPUT, ZFR  01  VT  ,  PEGir>*  ) ; 

CALL    ZEROOUT; 

PUT    EOIT('"FROG"S    MEMCPIES    HAVE    BEEN    UPDATED', 

•AND    "FROG"     IS    READY    FOP    ANOTHER    STIMULUS', 

STARLINE, STARLINE) 
(SKTP(3),XU0),A,SKIP,XU0),A,SKIP,A,SKIP,A); 
IF    GOODTST>=BADTST    THFN    HUNGER=MAX ( HUNGFR-O. 1030000 , ZERO) ; 
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ELSE  HUNGER =M AX ( HUNG ER-O. 05 00000, ZFRO) ; 
END; 

ELSE   on; 

CALL    MEMORY(PMtvlSUALCHAR,PAINfPMEMnUT,ZER"INT,REr,nNI  ; 

CALL    ZFROOUT; 

PUT    EDIT(«"FPOG"    HAS    ENCOUNTERED    A    PREDATOR    SO    IT», 

•RETREATS    TO     ITS    SAFE    BESTING    PLACE    IN    REGION    1', 

STARLINE,STARLINE» 
(SKIP(3)  ,X(37),A,SKIP,X(37)  ,A,SKIP(2)  ,A,SKIP,A); 
L0CATION=l; 

HIJNGFR  =  MIN(HUNGER+0.0  50C000f  ONE)  ; 
FATIGUE  =  MIN(FATIGUE«-0.1000000,ONF) ; 
END; 

COUNTER=COUNTE"+l; 

GO    TO    REG  IN; 
END; 

/*  DECISION  5  */ 
ELSE  00; 

PUT  CDIT( • IMPULSE  OF  "FROG"  TO  FEED  ««,FEED, 
•FATIGUE  LEVEL  =•, FATIGUE, 

•"FROG"  IS  TOO  TIRED  TO  MOVE •  ,  STARL INE, ST ARL INE ) 
(SKIP(2),X(40),A,F(10,7I,SKIP,XUO),A,F(10,7), 
SKIP,X(40)  ,A,SKIP<2) ,A,SKIP,A); 
FATIGUF  =  MAX(  FAT  I GUE-O.  2000000,  7.E  RO  ) ; 
CnUNTEP  =  COUNTFR«-l; 

HUNGE V=M I N (HUN GFR +0.05 00000, ONE) ; 
CALL  DECAY; 
GO  TO  BEGIN; 
END; 


MID:  PROCEDURE!  VISIN,  GTSTIN,  BTSTIN,  PAININ,  mreGN, 
MALARM,  MCUT,  MNODEC,  MPPNT  ); 


/*  SIMULATION  OF  A  MIU. 

THIS  SUBROUTINE  IS  INVCKED  BY  A  CALL  STATEMENT. 
THP  PARAMETFP  "VISIN"  IS  A  FOUR-MEMBER  ARRAY  WHICH  CONTAINS 
THE  VISUAL  CHARACTERISTICS  OF  TH=  STIMULUS;  ITS  MEMBERS 
HAVE  ATTPIBUTES  FIXED  DECIMAL  (9,7).  "GTSTIN",  "AUSTIN", AND 
"PAININ"  ARE  THE  VALUES  ^F  THE  GOOD  TASTE  OP,  THE  BAD  TASTE 
OF  AND  THE  PAIN  INFLICTED  PY  THE  STIMULUS;  EACH  OF  THE  PARA- 
METERS HAVE  THE  ATTPIBLTES  MXED  DECIMAL  (9,7).  "MREGN"  SPE- 
CIFIES THE  RFGION  IN  WHICH  THE  STIMULUS  HAS  BFEN  PRESENTED; 
IT  HAS  ATTRIBUTES  BINARY  FIXFD.  "MALARM",  "MOUT"  AND  "MNODEC" 
ARE  OUTPUTS  ALARMOUT,MIUOUT  AND  N0DEC4  OF  THE  Miu;  THEIR  ATT- 
RIBUTES ARE  FIXED  DECIMAL  (9,7).  "MPPINT"  IS  THE  PARAMETER 
WHICH  TELLS  THE  "MIU"  IF  A  MEMORY  DUMP  HAS  BEEN  REQUESTED; 
IT  HAS  ATTRIBUTES  FIXED  DFCIMAL(l).  IF  "MPRNT"*1  A  DUMP  IS 
SUPPLIED;  ELSE  IF  "MPRNT"=0,  THEN  THERE  IS  NO  DUMP.  */ 


DCL  !VISIN!4),GTSTIN,BTSTIN,PAININ,MALAPM,GTMISIN!4),BTMISIN(4) , 
PMIS!N(4),MOUT,MN0DEC,MIS0UT(4) , ALAPMI SOUT (4 ) ♦ NOPEC IS T 0N(  4) ) 
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DECIMAL    FIXED    (9,71, 
MREGM    BINARY    FIXED, 
MPRNT    DECIMAL    FIXED! 1) ; 

CALL  MEMORY(GTM,VISIN,GTSTIN,GTMEMOUT, MPRNT, MREGN) ; 
CALL  MEMORYC BTM,VlS I N,RTST IN, BTMEMOUT, MPRNT, MREGN); 
CALL    MEMORYIPM    , VI S I N, PAIN  IN, PME MDUT, MPRNT ,MR EGN ) ; 

GTMISIN(l)«GTMFMOUT( I); 

BTMISIN(l)»BTMEMOUT( 1); 

PMISINU)    «PMEMOUT(l); 

CALL    MIS(GTMTSIN(l),RTMISIN(l),PMISIN(l),MISnuT(l), 

ALARMISDUT( l),NODECISION( 1) ); 
GTMISTN(2)«SINODECISION(l) ,GTMFMOUT(2l ); 
RTMISIN(2)=S(NODECISTON(l) , BTMEMOUT < 2 ) ); 
PMISIN12)    =S(NOOECISION(l) ,PMEMO|jT(2) ) ; 
CALL    MIS(GTM!SIN(2),RTMISINC2) ,PMI S IN< 2  ) , MI SOUT (2 ) , 

ALARMISOUT(?),NOOECISI0N<2) ); 
N30ECISION(2)*MIN(NOCECISION( I ) , NOD EC  I S ION ( 2 ) ) ; 
GTMISTN(3)=S(N0DECISION(2),GTMEM0UTf 3)  I; 
BTMISIN(3)=S<NODECISION<2) ,RTMEMDUT( 3  I ) ; 
PMISIM3)    *S(NODECISlCN(2),PMEMOUT<3)); 
CALL    MIS(GTMISIN(3),BTMISIM3),PMISIN(3).MIS0UT(3), 

ALARM  I SOUT ( 31 ,NCOEC I S I  ON ( 3 } ); 
NOOECISION(3)»MTN(NOCECISION<2),NODECISION(3l ) ; 
GTMISIN<4)»S(N0DECISI0N(3) ,GTMEM0UT(4) ) ; 
BTMISIN(4)=S(N0DECISI0NC3),BTMEM0UT(4))  ; 
PMISIN(4)     =S(NODFCISICN(3) ,PMFM0UT(4) ); 
CALL    MIS(GTMISIN<4),PTMISIN(4) ,PMI S INC  4) , MI SOUT< 4) , 

ALARMISOUT(A)  ,NODEC I S ION< 4 )  ); 
N0DECISI0N(4)=MIN<NCCECISI0N(3),N0DECISI0N<4)  ); 

MALARM  =  MAX(ALARMISOUT(l),ALARMISOUT(2) , ALARM  I SOUT ( 3 ) , 

ALARMIS0UT(4)); 
MOUT=MAX(MISOUT(l) , M  I  SOUT ( 2 ) , M I SOUT ( 3 ) , MI SOUT (4)) ; 
MNnDEC=N0DFCISI0N(4) ; 

IF    MPRNT=l    THEN    PUT    PAGE; 
PUT    EDIT! 'OUTPUTS    OF    LEVELS 

MREGN, (GTMFPOUT( I) 

•OUTPUTS    OF    LEVELS 

MPEGN, (BTMEMOUTl I ) 

•OUTPUTS    OP    LEVELS 

MREGN,(PMEMOUT(I) 

(SKIP(3),X(10),A,F(1),X<5),4  F  <  I  2  ,  7 )  , 
SKIP<3),X<  10),A,F<1),X<6),4  F<12,7), 
SKIP(3),X(10),A,F(l),X(7),4    F(12,7)) ; 

PUT  EDIT( 'OUTPUTS  OF  MEMORY  INTEGRATION  SUBUNITS  OF  REGION  •, 
MREGN, 

•LEVEL  I  SUBUNIT:' ,MISOUT(l), AL4RMISOUT( 1) , 
NODECISION(  1), 

•LEVEL  2  SUBUNIT:»  ,MI  SOUT  (  2) ,  AL  ARMI  SOUT  {  2  )  , 
NODECISIONt  2) , 

•LEVEL  3  SUBUNIT: • ,MISOUT(3), ALA«MISOUT(3) , 
NODECISIONO)  , 

•LEVEL  4  SUBUNIT:' ,MI S0UTC4) , ALARMISOUT< 4) , 
NODECISIONI4) , 
•OUTPUT  OF  MIU  FOR  REGION  •, MREGN, •:• ,MOUT , 


OP 

GOOD  TASTE  MEMORY  FOR  REGION  •, 

DO 

I»l  TO  4), 

OP 

BAD  TASTE  MEMORY  FOR  REGION  •, 

no 

1=1  TO  4), 

OF 

PREDATOR  MEMORY  FOR  RFGION  •, 

if!  1 

[»l  TO  4)) 

8k 


•ALARM    niJTPUT    OF    MIU    FOR    REGION    •  ,  MREGN,  •  :  •  ,  MALARM) 
(SKIP{2),X(35),A,F<1) ,*( SK IP, X( 37) , A, 3    F{  10,7)  ) , 
SKIP.XUI) ,A,F(l) ,A,F<10,7), 
SKIP,X<38) , AfF(l) , A,F(10,7)); 


RETJRN; 
end  "iu; 


MIS:     PROCZDURE(GTLEVOUT, BTLEVOUT  ,PLEVOUT ,MI SOUT, ALARMI S ,NODEC) ; 


/*    SIMULATION    OF    MEMORY    INTEGRATION    SUBUNIT. 

ALL    SIGNAL    NAMES    CORRESPOND    TO    THOSE    IN    THE    LOGIC    DIAGRAM 
GIVEN    IN    FIGURE    3.5.    MIS    IS    INVOKED    BY    THE    USE    OF    A    CALL 
STATEMENT.    THP    SIX    FORMAL    PARAMETERS    HAVE    THE    ATTRIBUTES 
FIXED    DECIMAL(9,7).    THE    PARAMETERS    "GTLEVOUT",    "BTL^VOUT" 
ANn    "PLEVCUT"    CORRESPONDS    RESPECTIVELY    TO    THE    OUTPUTS    cROM 
THE    GTM,    THE    BTM    AND    THE    PM.    THE    PARAMETER    "MISOUT"    IS    THE 
NUMERICAL    VALUE    OF    THE    DECISION    IF    A    RUG    IS    SENSEO.    "ALARMIS" 
IS    THF    ALARM    OUTPUT    IF    A   PREDATOR    IS    SENSED;    "NOOEC"    IS    THE 
PARAMETER    WHICH    TELLS     IF    A    DECISION    HAS    BEEN    MADE    OP    NOT.    */ 


DCL    (GTLEV0UT,BTLEV0UT,PLEV0UT,MAXl,GTE,BTE,PE,CONTR0LG,C0NTR0L8, 
CnNTRnLP,MISOUT,ALARMIS,NODEC,SIGG, SIGB.SIGP) 
DECIMAL    FIXED    (9,71; 

MAXl  =  MAX(GTLEVOUT,BTL  EVOUT , PLEVOUT ) ; 

GTE«C(MAX1, GTLEVOUT)  ; 

BTE*E(MAX1, BTLEVOUT)  ; 
PE    »E(MAXl,PLEVnUT) ; 
SIGG«C( SI(GTE) ); 
SIGB»C(  SUBTE)  ); 
SIGP«C(SI(PEI)  ; 

CONTRCLG»MIN(SIGB,SIGP,S(GTE,GTE)  I J 
CONTROLB*MIN(SIGG,SIGP,S(BTE,BTE)); 
CONTROLP»MIN(SIGG,SIGe,S(PE,PE) I ; 

MISOUT*MAX(S(CONTROLG,GTE),(S(CONTPOLB,C(BTE»») I  ; 
ALARMIS«S(CCNTROLP,PE); 

NODEC»C (SI (MAX(CONTROLG,CCNTROLB,CONTROLP>) ); 
RFTURN; 
END  MIS; 


MEMORY:  PROCEOURECCODE, VISUAL, NONVISIN,MEMOUT,PRNT,REGN) ; 


/*  SIMULATION  OF  A  MEMORY;  THAT  IS,  A  GTM  OR  A  BTM  OR  A  PM. 
THIS  SUBROUTINE  IS  INVOKED  BY  A  CALL  STATEMENT. 
THE  PARAMETER  "CODE"  IS  A  CODE  WHICH  SPECIFIES  THE  TYPE  OF 
MEMORY.  "C0DE"=1  REFERS  TO  A  GTM.  "C0DE"«2  REFERS  TO  A  BTM. 
"C0DE"«3  REFERS  TO  A  PM.  THE  ATTRIBUTES  OF  "CODE"  ARE  FIXED 
BINARY.  THF  PARAMETER  "VISUAL"  IS  A  FOUR-MEMBER  ARRAY  WHICH 
CONTAINS  THE  VISUAL  CHARACTERISTICS  OF  THE  STIMULUS  BEING 
INPUT  TO  THE  MEMORY;  IT  HAS  ATTRIBUTES  FIXED  DECIMAL  (9,7). 
"MEMOUT"  IS  A  FOUR-MEMBER  ARRAY  WHICH  IS  USED  TO  RETURN  THE 
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OUTPUTS  OF  THE  FOUR  LEVLS;  ITS  MEMBERS  ALSO  HAVE  ATTRIBUTES 
FIXED  DFCTMAL  (9,7).  "PRNT"  IS  THE  PARAMETER  WHICH  TELLS 
"MEMORY"  IF  A  DUMP  HAS  BEEN  REQUESTED;  IT  HAS  ATTRIBUTES 
FIXED  DECIMAL  (II.  IF  "PRNT--1,  A  DUMP  IS  SUPPLIED;  ELSE  IF 
«PRNT"«0,  THEN  THERE  IS  NO  DUMP.  "REGN"  SPECIFIES  THE  REGION 
IN  WHICH  THE  STIMULUS  HAS  APPEAREO;  ITS  PARAMETERS  ARE  FIXED 
BINARY. 

THE  SECTION  OF  CODE  SIMULATING  LEVEL  1  IS  DOCUMENTED;  THE 
OTHER  LFVFLS  ARE  SIMULATED  IN  A  SIMILAR  FASHION. 


IN  OR 
THE  F 

COMBI 
COMB  I 
COMBI 
COMBI 

COMBI 
COMBI 
COMBI 
COMBI 
COMBI 
COMBI 

COMBI 
COMBI 
COMBI 
COMBI 


d;r  to 

OLLOWI 

NATION 
NATION 
NATION 
NATION 

NATION 
NATION 
NATION 
NATION 
NATtON 
NATION 

NATION 
NATION 
NATION 
NATION 


COMBINATION 


UND  = 
NG  AR 
LEV 
l»VI 
2»VI 
3-VI 
4«VI 
LEV 
1»VI 
2»VI 
3«VI 
4»VI 
5-VI 
6«VI 
LFVE 
l-Vl 
2«VI 
3»VI 
4-VI 
LEVE 
l»VI 


FOR  THE  FOUR  LEVELS: 


RSTAND  THE  MEMORY  OUMPS: 

E  THE  CCMBINATORIAL  INPUTS 

EL  I 

SUAL(l) 

SUALI2) 

SUALI3I 

SUAL(4) 

EL  2 

SUAL(l)  .' 

SUAL(  1}  ,' 

SUAL(l)  ,' 

SUAL(2),< 

SUAL(2),' 

SUAL<3»,< 

L  3 

SUAL(l)  t' 

SUAL(l)  f\ 

SUAL(l)f' 

SUAL(2)  »' 

L  4 

SUALI1)  ,VISUALI2),VISUAL(3),VISUALUI   */ 


,VISUAL(2) 
,VISUAL(3) 
,VISUAL<4) 
,VISUALC3) 
.VISUALU) 
,VISUAL(4) 

,VISUALI2),VISUAL(3) 
,VISUALI2),VISUAL<4) 

-VISUAL (3), VISUAL(4) 
,VISUAL(3) ,VISUAL(t) 


/* 
/* 
/* 
/* 


DCL  CODE  FIXED  BINARY,  /*  SPACIFIES  WHETHER  A  GTM,  A  BTM  OP  A  PM 
IS  REFERRED  TO  */ 

THE  FOUR  BASIC  VISUAL  CHARACTERISTICS  */ 
INPUT  C  ANO  OUTPUT  E  FOR  T*-ELEMENTS  */ 
THE  4-TUPLE  OUTPUT  F  FOR  T*-ELEMENTS  */ 
THE  OUTPUTS  OF  ALL  THE  LEVELS  */ 

INITM  16)  O.OOOOOOO), 
THE  INPUTS  TO  THE  FOUR  CHAINS  IN  LEVEL  I  */ 

INITM  24)  O.OOOOOOO), 
THE  INPUTS  TO  THE  SIX  CHAINS  IN  LEVEL  2  */ 

INITM  16)  0.0000000), 
THE  INPUTS  TO  THE  FOUR  CHAINS  IN  LEVEL  3  */ 

INITM  h)    0.0000000), 
THE  INPUTS  TO  THE  CHAIN  IN  LEVEL  4  */ 
/*  THE  ABOVE  VARIABLES  ARE  SO  DIMENSIONED  THAT  IT  IS  POSSIBLE 
TO  SPECIFY  FOUR  INPUTS  TO  EACH  T*-ELEMENTS  IN  EACH  LEVEL. 
SINCE  A  LEVEL  N  T*-ELEMENT  NEED  N  INPUTS  (N=l,2,3  OR  4), 
SOME  VARIABLES  ARE  NOT  USED  */ 
LEVIOUT,  /*  THE  OUTPUT  OF  LEVEL  1 
LEV20UT,  /*  THE  OUTPUT  OF  LEVEL 
LEV30UT,  /*  THE  OUTPUT  OF  LEVEL 
LEV40UT   /*  THE  OUTPUT  OF  LEVEL 
PRNT     /*  PARAMETER  WHCH  TELLS 


(VISUALU), 
NONVISIN, 
MEM0UTI4), 
OUTPUTU), 
LIVISINPT(4,4) 

/* 
L2VISINPT(6,4) 

/* 
L3VISINPTU,4) 

/* 
L4VISINPTC4) 

/* 


2 

3 
4 
IF 


*/ 
*/ 
*/ 
*/ 

A 


RFGN 


)  DECIMAL  FIXFD(9,7), 
MEMORY  DUMP  IS 
REOUESTED  */  FIXED  DECIMAL  (1), 
/*  THE  NUMBER  OF  THE  REGION  IN  WHICH  THE  STIMULUS 
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HAS  APPEAREC  */  FIXED  BINARY, 
/*  THE  FOLLOWING  TWO  VARIABLES  ARE  ASSOCIATED  WITH  THE  DECAY 

FUNCTION  */ 
TEMPO)  /*  SCRATCH  AREA  •/  FIXED  BINARY, 
CNTR(3)  /*  TEMPORARY  MARKER,  ONE  FOR  EACH  TYPE  OF  MEMORY, 

TO  SEE  HOW  MANY  T*-ELEMENTS  IN  A  CHAIN  HAVE  BEEN 

WRITTEN  1NTC  */  8IT  (1), 

/*  THE  FOLLOWING  FOUR  VARIABLES  ARE  FOR  TEMPORARY  STORAGE 
OF  THE  OUTPUT  STATUS  OF  EACH  T*-ELEMENT  IN  THE  BTM  IN 
IN  CASE  A  DUMP  IS  PEOUIRED  */ 
(LAST0UT1(4,3,4,3)  INITU144)  0,00000001, 
LAST0UT2(4,3,6,3)  INIT((216)  0.0000000), 
LASTnuT3(4,3,4,3)  INITU144)  0.0000000), 
LAST0UT4<4, 3,3)  INITU3M  0.0000000))  STATIC  DECIMAL  FIXEC  19,7), 

/*  THE  FOLLWING  LIST  OF  STORED  VALUES  FOR  ALL  THE  MEM-ELEMENTS 
AND  THE  STORED  VALUE  AND  FRACTION  MULTIPLIERS  OF  ALL  THE 
T-ELEMENTS  */ 
UL1TST0VAL(4,3,4,3),L3TST0VAL(4,3,4,3),L1TPFRACI4,3,4,3), 

L3TPPRAC(4,3,4,3))  INITIAL  (1144)  0.0000000), 
(L1MEM(4,3,4,3,6),L3MEM(4,3,4,3,6)) 

INITIAL  ((864)  0.0000000), 
(L2TST0VAL(4,3,6,3),L2TPF*AC(4,3,6,3)) 

INITIAL  ((216)  0.0000000), 
L2MEM(4,3,6,3,6)  INI TI AL (( 1296)  0.0000000), 

(L4TSTQVAL(4,3,3),L4TPFRAC(4,3,3) )  INITIAL((36)  0.0000000), 
L4MEM(4, 3,3,6)  INITIAL  I  (2161  0.0000000)) 
STATIC  DECIMAL  FIXFD  (9,7); 

/*  LEVEL  1  */ 
L1VISINPT(*.1)=VISUAL;  /*  SET  UP  VISUAL  INPUTS  FOR  EACH  CHAIN  */ 
OUTPUTU )«ZERO;  /*  INITIALIZE  LEVEL  1  OUTPUT  TO  ZERO  */ 
DO  1=1  TO  4;  /*  PARAMETER  "I"  IS  THE  NUMBER  OF  THE  CHAIN  */ 
NBHODD=ONE;  /*TURN  ON  SIGNAL  "NBHOOD"  AT  BEGINNING  OF 

EACH  CHAIN  */ 
CNTR(CODE)»'0«B;  /*  INITIALIZE  TEMPORARY  MARKER  */ 
DO  J=l  TO  3;  /*  PARAMETER  "J"  IS  THE  NUMBER  OF  THE  T*-ELFMENT 
IN  CHAIN  "I"  */ 
CALL  TSTAR(NONVISIN,ONEINT,L1VISINPT(I,*), 

L1MEM(REGN,C0DE, I , J, * ) , L1TST0VAL (REGN,CODE, I , J) , 
LITPFPAC(REGN,C0DE,I,J),LEV10UT,NBH00D) ; 
IF  LEV10UT-»ZER0  THEN  USE1 ( REGN,CODE , I , J )« • I • R ;  /*  SET  UP 

"USE"  ARRAY  WHICH  WILL  INOICATE  WHICH  T*-ELEMENTS 
OUTPUT  SOME  NONZERO  VALUE  DURING  A  READ  CYCLE  *7 
ELSE  GO  TO  Li;  /*  IF  THIS  T*-ELEMENT  HAS  NOT  OUTPUT  SOME 

NON-ZERO  VALUE  OURING  A  READ  CYCLE  */ 
0UTPUT(1)-MAX(0UTPUT( 1) ,LEVIOUT-DECAYN01 (REGN,COOE , I , J) I  J 
/*  IF  THIS  T*-ELEMENT  HAS  OUTPUT  SOME  NON-ZERO  VALUE, 
THEN  DECAY  IT  BY  THE  CORRECT  AMOUNT,  AND  XEEP  A 
RUNNING  MAXIMUM  TO  FIND  THE  LARGEST  T*-ELEMENT  OUTPUT 
FOR  LEVEL  1  */ 
LI I  LAST0UT1(REGN,C0DE, I , J ) -MAX( L1TST0VAL ( REGN.CODE, I , J ) 

♦LlTPFRAC(REGN,COCE, I , J J-DEC AYN01 ( REGN,CODE , I , J ) , ZERO) J 
/♦  SET  UP  THE  OUTPUT  STATUS  OF  THIS  T*-ELEMENT  IN  CASE 
A  DUMP  HAS  BEEN  REQUESTED  */ 
IF  -.CNTP(CODE)  6  L  ITSTOVALI  REGN,CODE  ,  I ,  J)»ZERO  THEN  DO; 
/*  WHEN  FIND  THE  FIRST  T*-ELEMENT  THE  CHAIN  THAT  HAS  NOT 
BEEN  WRITTEN  INTO  THEN  SET  "MEMCNT ( CODE) "  EQUAL  TO 
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THE  NUMBER  OF  THE  T*-ELEMENT  IMMEDIATELY  TO  ITS  LEFT. 
THIS  NUMBER  IJ-l)  WILL  TELL  "DECAY"  HOW  MANY  T+- 
ELEMENT  IN  EACH  CHAIN  HAVE  BEEN  WRITTEN  INTO  AND, 
HENCE,  HOW  MANY  T*-ELEMENTS  IN  EACH  ROW  TO  DECAY  */ 

CNTR(CODE)»«l»B;  /*  ONCE  A  VALUE  HAS  BEEN  SET  FOR 

"MFMCNT(CODE)"  IN  THIS  PASS  THROUGH  THE  CHAIN  THEN 
TURN  ON  THE  SIGNAL  THAT  WILL  PROHIBIT  ENTRY  INTO 
THIS  DO-GROUP  UNTIL  THE  NEXT  ITERATION  OF  "I"  */ 

TEMP(COD6)=J-l; 

MEMCNT ( CODF)*M AX (MEMCNT! CODE), TEMPI COOE) ); 

END; 

END; 
END; 

/*  LEVEL?  */ 
L2VISINPT! 1,1)  =  VISUALU)  ; 
L2VI SINPT( 1,21 » VISUAL (2); 

L?VISINPT(2, I  )  =  VISUAL!  1)  ; 
L2VISINPT(2,2)=VISUAL(3); 

L2VISINPT(3,1)=VISUAL!1)  ; 
L2VISINPT!3,2)«VISUAL!4>; 

L2VISINPT(4,l)»VISUAL(2); 
L2VISINPTU,2)»VISUALC3); 

L2VISINPT(5,1)=VISUAL!2); 
L2VISINPT(5,2)*VISUAL(4); 

L2VISINPT(6,1)=VISUAL(3) ; 
L2VISINPT(6,2)=VISUAL(4); 

OUTPUT(2l=ZERO; 
DO  1=1  TO  6; 
NBHOOD=ONE ; 
DO  J=l  TO  3; 

CALL    TSTAR(N1NVISIN,TW0INT,L2VISINPT{I,*), 

L2MEM(REGN,CODE, I , J,* ) ,L2TSTOVAH RE GN, CODE, I , J ) , 
L2TPcRAC(REGN,CODE, I , J  I , LEV20UT , NBHOHOI  ; 
IF    LEV20UT    -=ZFRO    THEN   USE2 ( REGN.CODE, I , J )  = • I • B ; 
ELSE    GO    TO    L2; 

OUTPUT(2)=MAX(OUTPUTI 2) ,LFV20UT-DECAYN02( REGN,CODE , I , J ) ) ; 
L2:    LASTOUT2(REGN,CODE, I , J )=MAX( L2TSTOVALI REGN ,CODE, I , J )* 

L2TPFRAC(REGN,CDDE,I,J)-OECAYN02(REGN,CODE,I,J),ZERO); 

END; 
END; 

/*    LEVEL    3    */ 

L3VISINPTI 1,1)* VISUAL! I); 
L3VISINPT! 1,2) "VISUAL!  2); 
L3VISINPTC1,3)*VISUAL(3); 


L3VISINPT!2,1)*VISUALI1); 
L3VISINPTC 2,2)= VISUAL! 2); 
L3VISINPT! 2,3)= VISUAL!*); 

L3VISINPT(3,1)»VISUAL(1); 
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L3VISINPT(3,2)=VISUAL(3) ; 
L3VISINPT(3,3)=VISUAL(4) ; 

L3VISINPT(4,1)=VISUAL<2) ; 
L3VISINPT(<,,2)  =  VISUAL(3)  ; 
L3VISINPT(4,  3)=VISUAL<4)  ; 

0UTPUT(3)=ZER0; 

on  1=1  TO  4; 

NBHOOD  =  ONE; 
DO  J=l  TO  3; 

CALL  TSTAP(N1NVISIN,THREEINT,L3VIS INPTf I,*>  , 

L3MEM(RPGN,COnE, I , J , * ) ,L3TST0VAL (RFGN,CODE, I  ,J), 
L3 T PF P AC (REGN, CO DE,T, J ),LEV30UT, NBHOOD) ; 
IF  LEV30UT  -.=  ZERO  THEN  USE3  (  REGN  ,CODE  ♦  I  ,  J  )  =  •  1  •  B  ; 
ELSE  GO  TO  L3; 

OUTPUT (3)=M AX  (OUTPUT (3) ,L EV 3PUT-CFCAYN03( REGN , CODE , I, J) ) ; 
L3:  LASTOUT3(RFGN,CODE,I,J)=MAX(L3TSTOVAL(REGN,COD=, I, J)* 

L3TPFRAC(OEGN,CODE, I , J) -DECAYN03 ( REGN, CODE, I, J) ,ZERO); 
END; 
END; 

/*  LEVEL  4  */ 
L4VISINPT=VI SUAL; 

0UTPUT(4)=ZER0; 
NRHOOD=ONF; 
DO  1=1  TO  3; 

CALL  TSTARCNONVI SI N , FOUR I NT ,L4V I S INPT  , 

L4MEM(REGN,CCDE,I,*),L4TST0VAL(REGN,C0DE, I) , 
L4TPPR AC (REGN, COPE, I ), LFV40UT, NBHOOD) ; 
IF  LEV4PUT  ^=  ZERO  THEN  USE4( REGN .COD^ , I ) = • 1 • B; 
ELSE  GO  TO  L4; 

OUTPUT (A) =MAX(OUTPUT(A)  ,L EV40UT-DPC AYN04(  REGN, CODE,  I  ) ) ; 
L4:  LASTOUTM REGN, CODE, I) =MAX ( L4T STOVAL( REGN, CODE , I ) * 

L4TPFP  AC(REGN,COCE, I )-DEC AYN04( REGN, CODE , I), ZERO); 
END; 


/*  SEND  OUTPUTS  OF  ALL  LEVELS  OF  MEMORY  BACK  TO  "FROG"  */ 
MEMOUT=OUTPUT; 

IF  PRNT=1  THFN  DO; 
DO  K=l  TO  4; 
IF  CODE=l  THEN  OH; 
PUT  EDIT(«nUTPUT  STATUS  OF  EACH  T*  ELEMENT  IN  REGION  «,K, 

•  OF  GOOD  TASTE  MEMORY  IS  NOW:»,»T*  ELEMENT  NUMBER* , 
•1'  ,'2» t'3'  ) 

(PAGE,SKIP(4),X(10) ,Af F ( I ) , A , SK IP ( 2 ) ,X( 64) ,A, 
SKIP,X(52),A,X(  19),A,X(  1<»)  ,  A,  SKIP)  ; 
END; 

ELSE  IF  CODE=2  THEN  DO; 
PUT  FDITCOUTPUT  STATUS  OF  EACH  T*  ELEMENT  IN  REGION  «,K, 

•  OF  BAD  TASTE  MEMORY  IS  NOW:,f,T*  ELEMENT 
•1« ,'2»  ,'3») 
(PAGE,SKIP(4),X( 1C),A,F(1) , A, SK IP( 2 ) , X( 64) , A, 

SKIP,X(52),A,X(19) ,A,X( 19), A, SKIP) ; 
END; 
ELSE  DO; 
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PUT  EDIT! 'OUTPUT  STATUS  OF  EACH  T*  ELEMENT  IN  REGION  »,K, 
•  OF  PREDATOR  MEMORY  IS  NOW:«,»T*  ELEMENT  NUMBER •♦ 
•l«,»2,,*3il 

(PAGE»SKIP<*),X(10),A,F(l),A,SKIPm,X(64),A, 
SKIP, XI 52), A, XI 19), A, XI  19  I, A, SKIP); 
END; 
DO  1=1  TO  4; 

PUT  EOITI'LEVEL  1» , ( LASTOUT1 IK ,CODE, I, J  I  DO  J«l  TO  3), 
•COMBINATION  »,I) 

ISKIP<?),XI2  5),A,XI15),FI10,7),XI10), 
F(10,7),XI10),F110,7),SKIP,XI25) ,A,F(1)); 
FNO; 
DO  I«l  TO  6; 

PUT  EDITI'LEVEL  2»  ,  I  LASTOUT2  IK, CODE,  I,  Jl  DO  J«l  TO  31, 
•COMBINATION  »,I) 

(SKIP(2),XI25),A,Xll5),FtlO,7),X<10), 
FU0,7),XI10),FI10,7),SKIP,X125),A,FII)); 
END; 
DO  1*1  TO  A; 

PUT    EDITI'LEVEL    3« , ( L AST0UT3 IK ,CODE , I , J )    DO    J*l    TO    3), 
•COMBINATION    »,I) 

ISKIP(2),X(25),A,X(15),FI10,7),XI10), 
F|10,7),X(10),FI10,7),SKIP,XI25),A,F11)); 
END; 

PUT  EDITI'LEVEL  *• , ( LAST0UT4I K ,CODE, I)  DO  I«l  TO  3), 
•COMBINATION  1M 

ISKIPI2),XI25),A,X(15),FI10,7), 
X(10),FI10,7)  ,XUO)  ,FI  10,  7),  SKIP,  XI  251  ,A); 
END; 
END; 
RETUPN; 
END  MEMORY; 


TSTAR:  PPOCEDURElNONVISUAL,TLEVEL,VISSTIM,MFMSTOVAL,TSTOVAL, 

TPR0DFRACTI0N,TSTAR0UT,NBH0OD) ; 


/*  SIMULATION  OF  A  T*-ELEMENT. 

ALL  SIGNAL  NAMES  CORRESPOND  TO  THOSE  IN  THE  LOGIC  DRAWING. 
TSTAR  IS  INVOKED  BY  USE  OF  A  CALL  STATEMENT.  ALL  OF  THE 
FORMAL  PARAMETERS  EXEPT  "TLEVEL",  HAVE  ATTRIBUTES  FIXED 
DECIMAL  19,7).  "TLEVEL"  IS  BINARY  FIXED.  "NONVISUAL"  IS  THE 
NONVISUAL  INPUT  TO  THE  T*-ELEMENT.  THE  T*-ELEMENTS  VARY  IN 
THE  NUMBER  OF  MEM  ELEMENTS.  THE  PARAMETERS  "VISSTIM"  AND 
••MEMSTOVAL"  ARE  ARRAYS  WHICH  ARE  DIMENSIONED  SUCH  THAT  THEY 
CAN  COPE  WITH  THE  MAXIMUM  VARIATION.  "VISSTIM"  IS  A  FOUR-  - 
MEMBER  ARRAY  WHICH  CORRESPOND  TO  MAXIMUM  OF  POUR  VISUAL 
INPUTS  TO  THE  T*-ELEMENT.  IF  THE  T--ELEMENT  HAS  LESS  THAN 
FOUR  INPUTS,  THE  HIGHER  INDEXED  MEMBERS  OF  THE  ARRAY  ARE 
SET  TO  ZERO.  "MEMSTOVAL"  IS  A  SIX  MEMBER  ARRAY  WHICH  CON- 
TAINS THE  STORED  VALUES  OF  A  MAXIMUM  OF  SIX  MEM-ELEMENTS 
CONTAINFO  IN  THE  T*-ELEMENT.  IF  THE  T*-ELEMENT  CONTAIN  LESS 
THAN  SIX  MEM-ELEMENTS  THE  CORRESPONDING  MEMBERS  OF  THE  ARRAY 
ARE  SET  TO  ZERO.  THE  PARAMETERS  "TSTOVAL"  AND  "TPRODFRACT ION" 
ARE  THE  STORED  VALUE  AND  FRACTION  MULTIPLIER  OF  THE  T-ELEMENT 
CONTAINED  IN  THE  T*-ELEMENT.  "TSTAROUT"  CORRESPONDS  TO  THE 
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D    OUTPUT,    THE    MAIN   OUTPUT,    "NBHOOD"    CORRESPONDS    TO   THE    C 
INPUT    WHEN    TSTAR    IS    INVOKED,    IS    MODIFIED,     AND    RETURNED    AS 
THE    E    OUTPUT.    "TLEVEL"    TELLS    WHICH   LEVEL    THIS    T*-ELEMENT 
IS    IN.    */ 


DCL    (NONVISUAL,TSTOVAL,TPRCDFRACTION,MO0N0NVISUAL,SIG,TIN, 

TSTAROUT,NBHOOD,PIN1,FIN2»MODPIN1,MODPIN2,MEMSTOVAL(6), 
MEMIN(6),VISSTIM(4),ECUT(6))     DECIMAL    FIXED    (9,7), 
TLEVEL    BINARY    FIXED; 
MnDN0NVISUAL=S(NONVISUAL,NONVlSUAL): 
SIG=MAX(MEMSTOVAL(5),MIN(C(MEMSTOVAL(5) ), 

NBHOOD,MODNONVISUAL) ) ; 
PIN1=0NE; 

DO    NN=1    TO    TLEVEL; 
MEMIN(NN)*S(SIG, VISSTIM(NN)) ; 

EOUT(NN)=E(MEMIN(NN),MEM(MEMIN(NN),MEMSTOVAL(NN) ) ) ; 
PIN1=MIN(PIN1,E0UT(NN) ) ; 

END; 

MFMIN(5)=S(SIG,M0DN0NVISUAL); 

EOUT(5)«E(MEMIN(5),MEM(MEMIN(5),MEMSTOVAL(5)) ); 
MEMIN(6)*S(MIN(PIN1,C(SI (E0UT(5») I )  ,MEMIN(5  )) ; 
E0UT(6)»E( MEMIN(6),MEH(MFMIN(6),MEMST0VAL<6))); 

PIN2»S(MAX(E0UT(5),E0UT(6)),MAX(MEMST0VAL(5),MEMST0VAL(6)I) 
MOCPINl«SI (PIN1); 
M0DPIN2=SI (PIN2); 

TIN=SMIN(M0DPIN1,M0DPIN2),P(PIN1,PIN21  ); 
TSTAR0UT=SCMIN(M0DPIN1,C(M0DPIN2) » , 

T(TLEVEL,TIN,TSTOVAL,TPRODFPACTION) ); 

nbh00d=min(nbh00d,c(si(tin) )); 

return; 

end  tstar; 


T:  PROCEDUREfLEVELNO, INPUT, STOVAL , PPODFRACTI  ON)  DECIMAL  FIXED  (9,7) 

/*  SIMULATION  OF  THE  T-ELEHENT. 

THIS  FUNCTION  IS  INVOKED  BY  THE  USE  OF 

"TILEVEL  NUMBER,  INPUT  TO  T-ELEMENT,  STORED  VALUE  OF  T- 

ELEMENT,  VALUE  OF  FRACTION  MULTIPLIER)" 
IN  AN  EXPRESSION.  THE  FIRST  ARGUMENT  HAS  THE  ATTRIBUTES 
FIXED  DECIMAL  (I), THE  OTHER  THREE  HAVE  THE  ATTRIBUTES  FIXED 
DECIMAL  (9,7);  THE  VALUE  RETURNED  TO  THE  POINT  OF  INVOCATION 
HAS  THE  ATTRIBUTES  FIXEC  DECIMAL  (9,7).  THE  PARAMETER 
"LEVELND"  CORRESPONDS  TO  THE  LEVEL  NUMBER;  THE  PARAMETER 
"INPUT"  IS  THE  INPUT  TO  THE  T-ELEMENT;  THE  PARAMETER 
"PRODFRACTION"  IS  THE  VALUE  OF  THE  FRACTION  MULTIPLIER. 
SINCE  THE  OUTPUTS  CONSTANTLY,  IF  "INPUT"»ZERO  THEN  THE  CURRFNT 
OUTPUT  STATUS  IS  RETURNED.  THE  "STOVAL"  SETS  TO  ANY  NON-ZERO 
VALUE  ON  "INPUT"  WHICH  ALSO  STEPS  "PRODFRACTION"  BY  I/N 
(IF  POSSIBLE)  AND  THE  NEW  OUTPUT  STATUS  RETURNED.  */ 

DCL  ( INPUT, STOVAL, PRODFR ACT ICN)  DECIMAL  FIXED  (9,7), 
LEVELNO  BINARY  FIXEO; 
IF  INPUT«ZERO  THEN  RETURN(STOVAL*PRODFRACTI ON) ; 
ELSE  DO; 
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STOVAL'I NPUT; 

CALl     CC'1PUTMPR0DFRACTICN,IEVEIN0); 
RFT'JRN(PRO0FRACTI0N*STOVAL); 
FND; 
END    T; 


MEM:     PROCEDURE  INPUT, STOPEDVALUE)    DECIMAL    FIXED    (9,7)     ; 

/♦    SIMULATION    OF     THE    MEM-ELEMENT. 

THIS    FUNCTION    IS    INVOKEO    BY    THE    USE    OF 

"MFM(  INPUT    TO    MEM-ELEMFKT,    STORED    VALUE    OF    MCM-eLEMFNT )  •• 
IN    AN    EXPPESSIHN.    BOTH    ARGUMENTS    H«VE    THE    ATTRIBUTES    FIXED 
DECIMAL     (9,7),     AS    DOES    THE    VALUE    PFTUPNED    TO    THE    POINT    OF 
INVOCATION.     THE    PARAMETER    ••INPUT"    CORRESPOND    TO    THE    INPUT 
TO    THE    *EM-Fl.cMFNT,    "STOREDVALUE"    CORRESPOND    Tfl    THE    VALUE 
STOPEO    WITHIN    THE    MEM-ELEMENT.     l^    "INPUT"     IS    ZERO,     THEN    THE 
OUTPUT    STATUS    OF    THE    MFP-ELFMFNT    IS    PETURNFD.    OTHERWISE,     IF 
THF    MCM-ELEMENT    IS    "UNSFT",     IT     IS    "SFT"    TO    THE    VALUF    OF    THE 
"INPUT".    "STORFDVALUF"     IS    THFN    RETURNED    TO    THE    POINT    OF    INVO- 
CATION.   */ 

DCL    ( INPUT, STOREDVALUE)    DECIMAL    FIXEO    (9,7); 
IF    STORECVALUE'ZERO   THEN    STOREDVALUE-INPUT; 
RETURN( STOREDVALUE); 

END    MEM; 


F:  PROCEDU"EIEXTINPUT,TINPLT)  DECIMAL  FIXED  (9,7); 

/*  SIMULATION  OF  E-ELEMENT. 

THIS  FUNCTION  IS  INVOKED  OY  THE  USE  OF  "E ( X2  INPUT, XI  INPUT)" 
IN  AN  EXPRESSION.  BOTH  4RGUMFNTS  MUST  H*VF  THF  ATTRIBUTES 
FIXED  DECIMAL  (9,7);  THF  VALUE  RETURNED  TO  THE  POINT  OF 
INVOCATION  HAS  SIMILAR  ATTRIBUTES.  THE  PARAMETER  "EXTINPUT" 
CORRESPONDS  TO  THE  X2  INPUT  TO  THE  E-ELEMENT;  THE  PARAMFTER 
"TINPUT"  CORRESPOND  TO  THE  XI  INPUT.  IF  THE  ABSOLUTE  VALUE 
OF  TINPUT  -  EXTINPUT  <»  0.5,  THEN  THF  VALUE  OF  TINPUT  IS  RE- 
TURNED TO  THE  POINT  OF  INVOCATION;  OTHER  WlSe  ZERO  IS  RE- 
TURNED. */ 

DCL  (EXTINPUT, TINPUT, NBHD  IN  IT ( 0 .0500000) )  DECIMAL  FIXED  (9,7); 
IF  ABS(TINPUT-EXTINPUTX»NBHD  THEN  RETUPN(  TINPUT)  ; 
ELSE  RETURN(ZERO); 
END  E; 


P:  PP0CEDURE(INPUT1,INPUT2)  DECIMAL  FIXED  (9,7); 

/*  SIMULATION  OF  P-ELEMENT. 

THIS  ^UNCTION  IS  INVOKEC  BY  THE  USE  OF  "P( INPUT, I NPUT ) "  IN 
AN  EXPRESSION.  BOTH  ARGUMENTS  MUST  HAVE  THE  ATTRIBUTES  FIXED 
DECIMAL  (9,7);  THE  VALUF  RETURNED  TO  THF  POINT  OF  INVOCATION 
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HAS  SIMILAR  ATTRIBUTES.  P  FORMS  THE  PRODUCT  OF  THE 
PARAMETERS  "INPUT1"  AND  "INPUT?"  AND  RETURNS  TO  THE  POINT 
OF  INVOCATION.  */ 

DCL  (  INPUTl,INPUT2)  DECIMAL  FIXED  (9,7); 
PETURNI  INPUT1MNPUT2)  ; 
END  P; 


S:  PROCEOURF(SIGNAL,GATE )  CECIMAL  FIXED  (9,7); 

/*  SIMULATION  Oc  S-ELFMENT. 

THIS  FUNCTION  IS  INVOKEC  RY  USE  OF  "S(X2  INPUT, XI  INPUT)" 
IN  AN  EXPRESSICN.  THE  ARGUMENTS  MUST  HAVE  THC  ATTRIRijTES 
CIXED  DECIMAL  (9,7);  THE  ATTRIBUTES  RETURNED  TO  THE  POINT  OF 
INVOCATION  HAS  SIMILAR  ATTRIBUTES.  THE  PARAMETER  "SIGNAL" 
CORRESPONDS  TO  THE  X2  INPUT  TO  THE  S-ELEMFNT;  THE  PARAMETER 
"GATE"  CORRESPONDS  TO  TFE  XI  INPUT.  IF  THE  VALUE  OF  "SIGNAL" 
IS  >=  0.5  THEN  THE  VALUE  OF  "GATE"  IS  RETURNED  TO  THF  POINT 
OF  INVOCATION;  IF  IT  IS  <  0.5  THEN  ZERO  IS  RETURNED.  */ 

DCL  (SIGNAL, GATE, PFIVE  IN  IT ( 0.5000000 ) )  DECIMAL  FIXED  (9,7); 

IF  SIGNAL<PFIVE  THEN  RETUPN( ZERO) ; 
ELSE  RETURN(GATE); 
END  s; 


SI:  PROCEDURE(SIGNAL)  DECIMAL  FIXEr  (9,7); 

/*  SIMULATION  OF  SI-ELEMFNT. 

INVOKED  BY  THE  USE  OF  "SKINPUTJ"  IN  AN  EXPRESSION,  THIS 
FUNCTION  PETUPNS  A  VALUE  TO  THE  POINT  OF  INVOCATION  WITH 
ATTRIBUTES  FIXED  DECIMAL  (9,7);  THE  ARGUMENT  MUST  HAVE  THE 
SAME  ATTRIBUTES.  THE  PARAMETER  "SIGNAL"  CORRESPONDS  TO  THE 
INPUT  TO  THE  SI-ELEMENT.  IF  "SIGNAL"  IS  >  ZERO,  THEN  THE 
VALUE  1.0  IS  RETURNED  TO  THE  POINT  OF  INVOCATION;  IF  "SIGNAL" 
=  0,  THEN  ZERO  IS  RETURNED.  */ 

DCL  SIGNAL  DECIMAL  FIXED  (9,7); 
IF  SIGNAL>ZERO  THEN  RETURN(ONE); 
ELSE  RETURN(ZEPO); 
END  si; 


C:  PROCEOURE(NUMBER)  DECIMAL  FIXED  (9,7); 

/*  SIMULATION  IF  C-ELEMENT. 

THIS  FUNCTION  IS  INVOKED  BY  THE  USE  OF  "CUNPUT  TO  C-ELEMENT)" 
IN  AN  EXPRESSION.  THE  ARGUMENTS  MUST  HAVE  THF  ATTRIBUTES 
FIXED  DECIMAL  (9,7);  THE  FUNCTION  RETURNS  A  VALUE  WITH  THE 
SAME  ATTRIBUTES.  THE  PARAMETER  "NUMBER"  CORRESPONDS  TO  THE 
INPUT  TO  THE  C-ELEMENT;  THE  CONTINUOUS  LOGIC  COMPLEMENT 
1-INPUT  IS  RETURNED  TO  THE  POINT  OF  INVOCATION.  */ 
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OCL    (NUMBER, ONE    INIT ( 1 .OOOOOOO) )    FIXED    DECIMAL    (9,7); 
RETURN(ONF-NUMBER) ; 


ENO   c; 

(NOFIXEDOVERFLOW) :  RANDOM:  PROCEDURE  BINARY  FLOAT  (31); 

/*  RANDOM  IS  SUBROUTINE  THAT  GENERATES  A  RANDOM  NUMBER  ON  THE 
CLOSED  INTERVAL  BETWEEN  ZERO  AND  ONE  EACH  TIME  IT  IS  CALLED 
THE  VALUE  OF  THIS  RANDOM  NUMBER  IS  THEN  USED  TO  DECIDE  WHICH 
STIMULUS  IS  TO  BE  PRESENTED  TO  FROG  AND  IN  WHICH  REGION.  */ 

DCL  (NUMBER, TEMP, 

FLCONST  INITl I  111  11 llll 11 11  111  I  ill  111  11 Ull 1F0B)) 
BINARY  FLOAT  (31) , 
(K  STATIC  INITI27), 

FIXCONST  INIT(2l*7483647) )  FIXED  BINARY  (31); 
K*K*(2**l6-3); 

if  k<o  Then  k=k*fixconst+i; 

TEMPaK; 

NUMBER- TEMP/ FLCONST; 

RETURN(NUMBER)  ; 

END  RANDOM; 


DECAY:  PROCEDURE; 

/*  DECAY  IS  SUBROUTINE  WHICH  SIMULATES  A  LEARNING  DECAY  PROCESS 
FOR  EACH  MEMORY  CELL.  IF  A  MEMORY  CELL  IS  NOT  USED  IN  A 
READ-CYCLE,  ITS  OUTPUT  ON  THE  NEXT  RFAD  CYCLE  IS  CAUSED  TO 
"DECAY"  BY  SOME  STANDARD  AMOUNT,  "FACTOR".  IF  ON  THE  OTHER 
HAND,  A  PARTICULAP  MEMORY  CELL  IS  USFC  ON  A  READ-CYCLE,  THEN, 
IF  ITS  OUTPUT  HAD  BEEN  DECAYED  PREVIOUSLY,  ITS  OUTPUT  IS 
INCREASED  BY  THE  STANDARD,  "FACTOR".  */ 

DCL  FACTOP  DECIMAL  FIXED(9,7)  I  NIT ( 0.0000500 ) ; 

L00°:  DO  1=1  TC  3; 
LL=MEMCNT(I ) ; 
IF  LL=0  THEN  GO  TO  CUT; 
DO  J=l  T0  4; 
DO  L»l  TO  ll; 
DO  K=l  TO  4; 
IF  -.USE1(J,I,K,L)  THEN 

DECAYNOK  J,  I,K,L)  =  DECAYNOl(Jf  I  ,  K  ,  L)  4-FACTOR; 
ELSE  DECAYNOK  Jf  I  ,  K  ,L  )  =  DEC  AYNOH  J  ,  I ,  K  ,  L) -FACTOR; 
END; 

DO  K«l  TO  6; 

IF  -»USE2(  J,I,K,L)  THEN 

DECAYN02C J, I , K ,L ) =PECAYN02( J, I , K , L ) ♦ FACTOR ; 
ELSE  DECAYN02( J , I , K,L )-DECAYN02 ( J , I , K,L )-FACTO° ; 

END; 
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DO  K=l  TO  4; 
IF  -USE3U, I,K, L)  THEN 

0ECAYN03(  Jt  I,K,L)=DECAYN03(  J , I , K,L ) ^FACTOR  ; 
ELSE  DECAYN03IJ, I, K, L) =DECAYN03( J, I , K ,L ) -FACTOR ; 

end; 

IF    -USEM JtltL)    THEN 

DECAYNOM  J,  I  ,L)=DECAYN04(J,  I , L I+FACTOP ; 
ELSE    D5CAYN04I J, I ,L )=DECAYN04( J , I ,L)-FACTOR; 


END; 
END; 
OUT:    ENO    LOOP; 
ZERPOUT:     ENTRY; 
USE1=»0,B 
USE2=,0»B 
USP3=»0'B 
USE4=«0fB: 

return; 
end  decay; 


COMPUTE:  PROCEDURE CFRACT ICN  , LEVEL); 


/*  COMPUTE  IS  A  SUBROUTINE  WHICH  SIMULATES  THE  S 
FRACTION  MULTIPLIER  OF  THE  T-ELEMENT  OUTPUT. 
BY  THE  STATEMENT  "CALL  CCMPUTE (FP ACT  I  ON, LEVFL 
THE  PARAMETER  "FRACTION"  HAS  ATTRIBUTES  PIXED 
THE  PARAMETER  "LEVEL"  HAS  ATTRIBUTES  FIXED  DE 
"FRACTION"  CORRESPONDS  TO  THE  VALUE  OF  THE  FR 
PLICR,  AND  "LEVEL"  TO  THE  NUMBER  OF  THE  LEV«=L 
THE  T-ELEMENT  WHOSE  FRACTIONS  MULTIPLIER  IS  B 
IP  THE  VALUE  OF  "FRACTION"  IS  1.0,  THFN  THE  T 
WHICH  TT  IS  ASSOCIATED  HAS  REACHED  FULL  POTEN 
OF  "FRACTION"  IS  RETURNED  UNCHANGED.  CTHERWIS 
IS  INCREMENTED  ACCORDING  TO  THE  LFVFL  NUMBEP 


TEPPING  OF  THE 
IT  IS  INVOKED 

NUMBER )"; 

DECIMALS, 7); 
CI"AL  (I). 
ACTION  MULTI- 

WHICH  CONTAINS 
EING  STEPPED. 
-ELEMENT  WITH 
TIAL  SO  THE  VALUF 
E,  "FRACTION" 
AND  RETURNED.  */ 


dcl  fraction  decimal  fixed  (9,7), 

level  rinapy  fixed, 

onehalf  decimal  fixed  (8,7)  ini t ( 0. 5000000) , 

onefourth  decimal  pixed  (8,7)  i ni t ( 0. 2500000 ) , 

onesixth  decimal  fixed  (8,7)  i  nit ( 0. 1666667) , 
onefighth  decimal  fixed  (8,7)  in  i t ( 0. 1250000) , 

one  binary  fixed  init(l), 

two  binary  fixed  init(2), 

three  binary  fixed  init13); 
if  fractional 0000000  thfn  return; 
if  level=one  then  do; 

fraction=fr act ion+one eighth; 

RETURN; 
FND; 

else  if  level=two  then  do: 

fr ac t ion=fr act ion+one sixth; 

return; 

END; 
else  if  levfl=three  then  do; 

fraction=fraction+one fourth; 
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RETURN: 
END; 
ELSE  DO; 

fraction*fraction*onehalf; 
return; 

END; 
END  COMPUTE; 


TF.RM:  END  FRCG: 
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APPENDIX  C 


SAMPLE  OUTPUTS 


Some  sample  outputs  are  given  in  the  following  pages.   The 
outputs  are  for  trial  #s  69,  120  and  250.   In  trial  #69  FROG  had  to 
consult  its  memory  for  all  regions  to  come  to  a  decision.   The  decision 
was  specific  to  the  region  in  both  the  trials  120  and  250.   A  memory 
dump  was  requested  in  trial  #250. 
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